2024-05-04T07:37:36.781 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-04T07:37:36.781 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555 --verbose --owner scheduled_rishabh@teuthology --name rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls} -- /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/orig.config.yaml 2024-05-04T07:37:36.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T07:37:36.929 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555 branch: wip-rishabh-testing-20240503.134948 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls} email: null first_in_suite: false job_id: '7690555' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240503.134948 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Reduced data availability - Degraded data redundancy sha1: 25eb20a061356442d4a1c711818ce2e5848c382d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 25eb20a061356442d4a1c711818ce2e5848c382d kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240503.134948 sha1: 25eb20a061356442d4a1c711818ce2e5848c382d owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2794 sha1: 25eb20a061356442d4a1c711818ce2e5848c382d sleep_before_teardown: 0 subset: 509/512 suite: fs suite_branch: wip-rishabh-testing-20240503.134948 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_25eb20a061356442d4a1c711818ce2e5848c382d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 25eb20a061356442d4a1c711818ce2e5848c382d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQriPLX4c3SiOqgiZMjYHb4G+KMEsi/NxqVdmgoVCaKzVpZREii2n1ZJMbBDC/eb+npKopW3fQD1xiE6eah0Qs= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXBZkzWTE/wrx1tZLb5+b+NI6Ozf9lAMzfpTF93/t4EnogP61iUJTNK3AEezIwJIA16lnQZ2WfzQpzk0pnUtJg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-04_04:44:58 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-04T07:37:36.929 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_25eb20a061356442d4a1c711818ce2e5848c382d/qa; will attempt to use it 2024-05-04T07:37:36.930 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_25eb20a061356442d4a1c711818ce2e5848c382d/qa/tasks 2024-05-04T07:37:36.930 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-04T07:37:36.932 INFO:teuthology.task.internal:Checking packages... 2024-05-04T07:37:36.955 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '25eb20a061356442d4a1c711818ce2e5848c382d' 2024-05-04T07:37:36.955 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-04T07:37:36.955 INFO:teuthology.packaging:ref: None 2024-05-04T07:37:36.955 INFO:teuthology.packaging:tag: None 2024-05-04T07:37:36.955 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240503.134948 2024-05-04T07:37:36.955 INFO:teuthology.packaging:sha1: 25eb20a061356442d4a1c711818ce2e5848c382d 2024-05-04T07:37:36.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240503.134948 2024-05-04T07:37:37.110 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3500.g25eb20a0 2024-05-04T07:37:37.112 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-04T07:37:37.118 INFO:teuthology.task.internal:no buildpackages task found 2024-05-04T07:37:37.119 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-04T07:37:37.136 INFO:teuthology.task.internal:Saving configuration 2024-05-04T07:37:37.153 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-04T07:37:37.159 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T07:37:37.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 07:32:28.225484', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQriPLX4c3SiOqgiZMjYHb4G+KMEsi/NxqVdmgoVCaKzVpZREii2n1ZJMbBDC/eb+npKopW3fQD1xiE6eah0Qs='} 2024-05-04T07:37:37.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 07:32:28.227488', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXBZkzWTE/wrx1tZLb5+b+NI6Ozf9lAMzfpTF93/t4EnogP61iUJTNK3AEezIwJIA16lnQZ2WfzQpzk0pnUtJg='} 2024-05-04T07:37:37.218 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-04T07:37:37.224 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-04T07:37:37.224 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-04T07:37:37.225 INFO:teuthology.run_tasks:Running task console_log... 2024-05-04T07:37:37.301 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1da5e81160>, signals=[15]) 2024-05-04T07:37:37.301 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-04T07:37:37.307 INFO:teuthology.task.internal:Opening connections... 2024-05-04T07:37:37.308 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:37:37.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:37:37.411 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:37:37.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:37:37.495 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-04T07:37:37.501 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-05-04T07:37:37.519 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-05-04T07:37:37.519 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-05-04T07:37:37.576 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-05-04T07:37:37.577 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-04T07:37:37.578 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-04T07:37:37.578 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-04T07:37:37.578 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-05-04T07:37:37.602 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-05-04T07:37:37.620 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-05-04T07:37:37.621 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-05-04T07:37:37.678 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-04T07:37:37.679 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-04T07:37:37.680 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-05-04T07:37:37.710 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-04T07:37:37.721 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-04T07:37:37.725 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-04T07:37:37.726 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-05-04T07:37:37.728 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-05-04T07:37:37.744 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-04T07:37:37.750 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-04T07:37:37.750 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-05-04T07:37:37.784 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-05-04T07:37:37.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-04T07:37:37.949 INFO:teuthology.run_tasks:Running task kernel... 2024-05-04T07:37:37.963 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-04T07:37:37.963 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-04T07:37:37.963 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-04T07:37:37.964 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T07:37:37.964 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T07:37:37.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:37:37.981 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-04T07:37:37.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:37:37.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-04T07:37:38.147 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:38.147 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-04T07:37:38.147 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-05-04T07:37:38.157 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:38.158 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-04T07:37:38.158 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-05-04T07:37:38.164 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-437.el9.x86_64 2024-05-04T07:37:38.164 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:38.165 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-04T07:37:38.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum upgrade -y linux-firmware 2024-05-04T07:37:38.175 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-437.el9.x86_64 2024-05-04T07:37:38.175 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:38.175 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-04T07:37:38.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2024-05-04T07:37:40.418 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-05-04T07:37:40.975 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.0 MB 00:01 2024-05-04T07:37:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-04T07:37:43.535 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-05-04T07:37:47.763 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.2 MB 00:00 2024-05-04T07:37:49.143 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-05-04T07:37:49.545 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-04T07:37:50.535 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 16 kB 00:00 2024-05-04T07:37:52.179 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 21 MB 00:02 2024-05-04T07:37:52.555 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-04T07:37:57.203 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-04T07:37:57.627 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-04T07:37:59.196 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-05-04T07:37:59.197 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-05-04T07:37:59.197 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-05-04T07:37:59.325 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-04T07:37:59.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:59.547 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-05-04T07:37:59.548 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-05-04T07:37:59.548 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-05-04T07:37:59.562 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-04T07:37:59.562 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-04T07:37:59.564 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi136.front.sepia.ceph.com to complete... 2024-05-04T07:37:59.656 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-04T07:37:59.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-04T07:37:59.896 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-04T07:37:59.896 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-04T07:37:59.898 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2024-05-04T07:38:13.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04 07:38:13 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-04T07:38:13.056 INFO:teuthology.orchestra.run.smithi136.stderr:FINISHED --2024-05-04 07:38:13-- 2024-05-04T07:38:13.056 INFO:teuthology.orchestra.run.smithi136.stderr:Total wall clock time: 13s 2024-05-04T07:38:13.056 INFO:teuthology.orchestra.run.smithi136.stderr:Downloaded: 1 files, 341M in 13s (26.0 MB/s) 2024-05-04T07:38:13.059 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-04T07:38:13.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-04T07:38:15.180 INFO:teuthology.orchestra.run.smithi136.stdout:Verifying... ######################################## 2024-05-04T07:38:15.316 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing... ######################################## 2024-05-04T07:38:15.442 INFO:teuthology.orchestra.run.smithi136.stdout:Updating / installing... 2024-05-04T07:38:23.444 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-04T07:38:24.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04 07:38:24 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-04T07:38:24.045 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2024-05-04 07:38:24-- 2024-05-04T07:38:24.045 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 24s 2024-05-04T07:38:24.045 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 341M in 24s (14.3 MB/s) 2024-05-04T07:38:24.048 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-04T07:38:24.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-04T07:38:26.240 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2024-05-04T07:38:26.432 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2024-05-04T07:38:26.552 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2024-05-04T07:38:34.551 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-04T07:39:03.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-04T07:39:03.072 DEBUG:teuthology.orchestra.run.smithi136:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-04T07:39:03.147 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-04T07:39:03.148 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-04T07:39:03.149 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-04T07:39:03.150 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-04T07:39:03.151 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-04T07:39:03.152 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-04T07:39:03.153 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-04T07:39:03.154 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-04T07:39:03.155 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-04T07:39:03.156 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-04T07:39:03.157 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-04T07:39:03.158 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-04T07:39:03.159 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-04T07:39:03.160 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-04T07:39:03.161 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-04T07:39:03.162 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-04T07:39:03.163 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-04T07:39:03.164 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-04T07:39:03.165 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-04T07:39:03.166 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-04T07:39:03.167 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-04T07:39:03.168 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-04T07:39:03.169 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-04T07:39:03.170 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-04T07:39:03.171 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-04T07:39:03.172 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-04T07:39:03.173 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-04T07:39:03.174 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-04T07:39:03.175 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-04T07:39:03.176 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-04T07:39:03.177 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-04T07:39:03.178 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-04T07:39:03.179 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-04T07:39:03.180 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-04T07:39:03.181 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-04T07:39:03.182 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-04T07:39:03.183 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-04T07:39:03.184 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-04T07:39:03.185 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-04T07:39:03.186 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-04T07:39:03.187 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-04T07:39:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-04T07:39:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-04T07:39:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-04T07:39:03.191 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-04T07:39:03.192 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-04T07:39:03.193 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-04T07:39:03.194 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-04T07:39:03.195 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-04T07:39:03.196 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-04T07:39:03.197 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-04T07:39:03.198 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-04T07:39:03.199 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-04T07:39:03.200 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-04T07:39:03.201 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-04T07:39:03.202 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-04T07:39:03.203 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-04T07:39:03.204 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-04T07:39:03.207 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-04T07:39:03.208 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-04T07:39:03.209 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-04T07:39:03.210 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-04T07:39:03.211 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-04T07:39:03.212 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-04T07:39:03.213 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-04T07:39:03.214 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-04T07:39:03.215 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-04T07:39:03.216 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-04T07:39:03.217 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-04T07:39:03.218 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-04T07:39:03.219 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-04T07:39:03.220 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-04T07:39:03.221 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-04T07:39:03.222 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-04T07:39:03.223 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-04T07:39:03.224 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-04T07:39:03.225 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-04T07:39:03.226 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-04T07:39:03.227 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-04T07:39:03.228 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-04T07:39:03.229 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-04T07:39:03.230 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-04T07:39:03.231 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-04T07:39:03.232 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-04T07:39:03.233 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-04T07:39:03.234 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-04T07:39:03.235 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-04T07:39:03.236 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-04T07:39:03.237 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-04T07:39:03.238 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-04T07:39:03.239 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-04T07:39:03.240 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-04T07:39:03.241 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-04T07:39:03.242 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-04T07:39:03.243 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-04T07:39:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-04T07:39:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-04T07:39:03.246 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-04T07:39:03.247 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-04T07:39:03.248 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-04T07:39:03.249 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-04T07:39:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-04T07:39:03.251 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-04T07:39:03.252 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-04T07:39:03.253 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-04T07:39:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-04T07:39:03.255 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-04T07:39:03.256 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-04T07:39:03.257 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-04T07:39:03.258 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-04T07:39:03.259 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-04T07:39:03.260 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-04T07:39:03.261 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-04T07:39:03.262 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-04T07:39:03.263 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-04T07:39:03.264 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-04T07:39:03.265 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-04T07:39:03.266 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-04T07:39:03.267 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-04T07:39:03.268 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-04T07:39:03.269 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-04T07:39:03.270 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-04T07:39:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-04T07:39:03.272 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-04T07:39:03.273 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-04T07:39:03.274 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-04T07:39:03.275 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-04T07:39:03.276 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-04T07:39:03.277 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-04T07:39:03.278 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-04T07:39:03.279 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-04T07:39:03.280 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-04T07:39:03.281 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-04T07:39:03.282 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-04T07:39:03.283 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-04T07:39:03.284 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-04T07:39:03.285 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-04T07:39:03.286 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-04T07:39:03.287 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-04T07:39:03.288 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-04T07:39:03.289 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-04T07:39:03.290 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-04T07:39:03.291 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-04T07:39:03.292 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-04T07:39:03.293 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-04T07:39:03.294 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-04T07:39:03.295 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-04T07:39:03.296 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-04T07:39:03.297 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-04T07:39:03.298 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-04T07:39:03.299 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-04T07:39:03.300 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-04T07:39:03.301 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-04T07:39:03.302 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-04T07:39:03.303 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-04T07:39:03.304 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-04T07:39:03.305 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-04T07:39:03.306 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-04T07:39:03.307 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-04T07:39:03.308 INFO:teuthology.orchestra.run.smithi136.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-04T07:39:03.314 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.315 DEBUG:teuthology.orchestra.run.smithi136:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-04T07:39:03.338 INFO:teuthology.orchestra.run.smithi136.stdout:postinstall scriptlet (using /bin/sh): 2024-05-04T07:39:03.338 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-04T07:39:03.338 INFO:teuthology.orchestra.run.smithi136.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-04T07:39:03.338 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-05-04T07:39:03.338 INFO:teuthology.orchestra.run.smithi136.stdout:for file in vmlinuz System.map config; do 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: fi 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:done 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.339 INFO:teuthology.orchestra.run.smithi136.stdout:fi 2024-05-04T07:39:03.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-05-04T07:39:03.413 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-04T07:39:03.414 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-04T07:39:03.415 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-05-04T07:39:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:39:03.416 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-05-04T07:39:03.417 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-04T07:39:03.417 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:03.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-04T07:39:03.980 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-05-04T07:39:05.452 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-04T07:39:05.479 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-05-04T07:39:05.481 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-05-04T07:39:05.499 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.hiJfDU2vvT 2024-05-04T07:39:05.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hiJfDU2vvT 2024-05-04T07:39:05.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.hiJfDU2vvT 2024-05-04T07:39:05.694 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.hiJfDU2vvT is 6KB 2024-05-04T07:39:05.742 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.hiJfDU2vvT 2024-05-04T07:39:05.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-05-04T07:39:05.817 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-04T07:39:05.817 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-04T07:39:05.817 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-04T07:39:05.817 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-04T07:39:05.819 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:05.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-05-04T07:39:13.136 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-04T07:39:13.136 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-04T07:39:13.210 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.210 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.210 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-04T07:39:13.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-04T07:39:13.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-04T07:39:13.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-04T07:39:13.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-04T07:39:13.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-04T07:39:13.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-04T07:39:13.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-04T07:39:13.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-04T07:39:13.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-04T07:39:13.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-04T07:39:13.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-04T07:39:13.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-04T07:39:13.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-04T07:39:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-04T07:39:13.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-04T07:39:13.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-04T07:39:13.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-04T07:39:13.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-04T07:39:13.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-04T07:39:13.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-04T07:39:13.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-04T07:39:13.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-04T07:39:13.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-04T07:39:13.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-04T07:39:13.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-04T07:39:13.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-04T07:39:13.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-04T07:39:13.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-04T07:39:13.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-04T07:39:13.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-04T07:39:13.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-04T07:39:13.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-04T07:39:13.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-04T07:39:13.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-04T07:39:13.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-04T07:39:13.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-04T07:39:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-04T07:39:13.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-04T07:39:13.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-04T07:39:13.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-04T07:39:13.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-04T07:39:13.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-04T07:39:13.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-04T07:39:13.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-04T07:39:13.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-04T07:39:13.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-04T07:39:13.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-04T07:39:13.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-04T07:39:13.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-04T07:39:13.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-04T07:39:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-04T07:39:13.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-04T07:39:13.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-04T07:39:13.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-04T07:39:13.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-04T07:39:13.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-04T07:39:13.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-04T07:39:13.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-04T07:39:13.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-04T07:39:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-04T07:39:13.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-04T07:39:13.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-04T07:39:13.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-04T07:39:13.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-04T07:39:13.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-04T07:39:13.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-04T07:39:13.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-04T07:39:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-04T07:39:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-04T07:39:13.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-04T07:39:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-04T07:39:13.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-04T07:39:13.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-04T07:39:13.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-04T07:39:13.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-04T07:39:13.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-04T07:39:13.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-04T07:39:13.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-04T07:39:13.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-04T07:39:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-04T07:39:13.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-04T07:39:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-04T07:39:13.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-04T07:39:13.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-04T07:39:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-04T07:39:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-04T07:39:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-04T07:39:13.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-04T07:39:13.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-04T07:39:13.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-04T07:39:13.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-04T07:39:13.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-04T07:39:13.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-04T07:39:13.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-04T07:39:13.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-04T07:39:13.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-04T07:39:13.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-04T07:39:13.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-04T07:39:13.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-04T07:39:13.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-04T07:39:13.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-04T07:39:13.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-04T07:39:13.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-04T07:39:13.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-04T07:39:13.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-04T07:39:13.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-04T07:39:13.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-04T07:39:13.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-04T07:39:13.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-04T07:39:13.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-04T07:39:13.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-04T07:39:13.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-04T07:39:13.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-04T07:39:13.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-04T07:39:13.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-04T07:39:13.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-04T07:39:13.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-04T07:39:13.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-04T07:39:13.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-04T07:39:13.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-04T07:39:13.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-04T07:39:13.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-04T07:39:13.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-04T07:39:13.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-04T07:39:13.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-04T07:39:13.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-04T07:39:13.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-04T07:39:13.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-04T07:39:13.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-04T07:39:13.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-04T07:39:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-04T07:39:13.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-04T07:39:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-04T07:39:13.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-04T07:39:13.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-04T07:39:13.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-04T07:39:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-04T07:39:13.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-04T07:39:13.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-04T07:39:13.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-04T07:39:13.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-04T07:39:13.351 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-04T07:39:13.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-04T07:39:13.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-04T07:39:13.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-04T07:39:13.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-04T07:39:13.352 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-04T07:39:13.356 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.356 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-04T07:39:13.379 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2024-05-04T07:39:13.379 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-04T07:39:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-04T07:39:13.379 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-05-04T07:39:13.379 INFO:teuthology.orchestra.run.smithi142.stdout:for file in vmlinuz System.map config; do 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: fi 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-04T07:39:13.380 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-04T07:39:13.381 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.381 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2024-05-04T07:39:13.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-05-04T07:39:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-05-04T07:39:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-05-04T07:39:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-05-04T07:39:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-05-04T07:39:13.452 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:39:13.453 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-04T07:39:13.454 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-04T07:39:13.454 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-04T07:39:13.454 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-05-04T07:39:13.454 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:39:13.454 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-05-04T07:39:13.455 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-04T07:39:13.455 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:13.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-04T07:39:13.968 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-05-04T07:39:15.411 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-04T07:39:15.438 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-05-04T07:39:15.440 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-05-04T07:39:15.460 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Fds96xpUY0 2024-05-04T07:39:15.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Fds96xpUY0 2024-05-04T07:39:15.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.Fds96xpUY0 2024-05-04T07:39:15.669 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.Fds96xpUY0 is 6KB 2024-05-04T07:39:15.717 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.Fds96xpUY0 2024-05-04T07:39:15.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-05-04T07:39:15.803 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-04T07:39:15.803 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-04T07:39:15.803 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-04T07:39:15.803 INFO:teuthology.orchestra.run.smithi142.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-04T07:39:15.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-04T07:39:15.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-05-04T07:39:35.982 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-04T07:39:35.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:39:35.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:39:45.966 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-04T07:39:45.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:39:45.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:39:54.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-05-04T07:40:03.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:40:03.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:40:04.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-05-04T07:40:06.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-05-04T07:40:13.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:40:13.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:40:16.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-05-04T07:40:18.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:40:18.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:40:28.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:40:28.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:40:37.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-05-04T07:40:47.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-05-04T07:40:52.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:40:52.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:40:52.450 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-05-04T07:40:53.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:40:53.143 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-04T07:40:53.143 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-05-04T07:40:53.183 INFO:teuthology.orchestra.run.smithi136.stdout:6.9.0-rc3-g806ec36b2112 2024-05-04T07:40:53.183 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-04T07:40:53.183 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-04T07:40:53.183 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-04T07:40:54.185 DEBUG:teuthology.parallel:result is None 2024-05-04T07:41:02.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:41:02.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:41:04.620 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-05-04T07:41:05.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:41:05.268 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-04T07:41:05.268 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-05-04T07:41:05.306 INFO:teuthology.orchestra.run.smithi142.stdout:6.9.0-rc3-g806ec36b2112 2024-05-04T07:41:05.306 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-04T07:41:05.306 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-04T07:41:05.306 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-04T07:41:06.307 DEBUG:teuthology.parallel:result is None 2024-05-04T07:41:06.307 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-04T07:41:06.322 INFO:teuthology.task.internal:Creating test directory... 2024-05-04T07:41:06.323 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T07:41:06.328 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T07:41:06.371 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-04T07:41:06.378 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-04T07:41:06.391 INFO:teuthology.task.internal:Creating archive directory... 2024-05-04T07:41:06.392 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T07:41:06.409 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T07:41:06.473 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-04T07:41:06.485 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-04T07:41:06.486 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T07:41:06.490 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T07:41:06.623 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T07:41:06.634 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T07:41:06.692 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T07:41:06.702 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T07:41:06.707 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-04T07:41:06.716 INFO:teuthology.task.internal:Configuring sudo... 2024-05-04T07:41:06.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T07:41:06.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T07:41:06.843 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-04T07:41:06.856 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-04T07:41:06.856 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T07:41:06.868 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T07:41:06.941 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T07:41:07.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T07:41:07.173 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T07:41:07.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T07:41:07.405 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:41:07.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T07:41:07.512 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T07:41:07.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T07:41:07.669 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T07:41:07.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T07:41:07.824 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:41:07.824 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T07:41:07.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-05-04T07:41:07.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-05-04T07:41:08.029 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T07:41:08.072 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T07:41:08.488 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-04T07:41:08.496 INFO:teuthology.task.internal:Starting timer... 2024-05-04T07:41:08.496 INFO:teuthology.run_tasks:Running task pcp... 2024-05-04T07:41:08.638 INFO:teuthology.run_tasks:Running task selinux... 2024-05-04T07:41:08.678 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-04T07:41:08.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-05-04T07:41:08.771 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-05-04T07:41:08.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-05-04T07:41:08.892 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-05-04T07:41:08.897 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-04T07:41:08.897 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-05-04T07:41:08.952 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-05-04T07:41:08.952 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-05-04T07:41:09.005 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-05-04T07:41:09.006 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-05-04T07:41:09.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T07:41:09.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:41:09.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T07:41:09.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:41:09.152 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-04T07:41:09.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-05-04T07:41:09.232 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-05-04T07:41:09.305 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-04T07:41:09.315 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-04T07:41:09.321 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-04T07:41:09.471 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-04T07:41:09.488 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-04T07:41:09.489 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi136.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-04T07:46:43.604 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-05-04T07:46:43.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:46:43.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:46:43.728 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-05-04T07:46:43.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-04T07:46:43.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:46:43.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T07:46:44.020 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-05-04T07:46:44.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-05-04T07:46:44.177 INFO:teuthology.run_tasks:Running task clock... 2024-05-04T07:46:44.189 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-04T07:46:44.189 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T07:46:44.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T07:46:44.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T07:46:44.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T07:46:44.280 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-04T07:46:44.283 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-04T07:46:44.321 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-04T07:46:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-04T07:46:44.387 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-05-04T07:46:44.399 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-05-04T07:46:44.421 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-05-04T07:46:44.429 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-05-04T07:46:44.460 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-04T07:46:44.470 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-04T07:46:44.502 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-04T07:46:44.513 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-04T07:46:44.644 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-05-04T07:46:44.653 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T07:46:44.653 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-05-04T07:46:44.653 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.654 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.654 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.654 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.655 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-04T07:46:44.661 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T07:46:44.662 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-04T07:46:44.662 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.662 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.662 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.663 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:46:44.664 INFO:teuthology.run_tasks:Running task install... 2024-05-04T07:46:44.674 DEBUG:teuthology.task.install:project ceph 2024-05-04T07:46:44.674 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'}} 2024-05-04T07:46:44.674 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'} 2024-05-04T07:46:44.674 INFO:teuthology.task.install:Using flavor: default 2024-05-04T07:46:44.680 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-04T07:46:44.681 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-04T07:46:44.681 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d', 'tag': None, 'wait_for_package': False} 2024-05-04T07:46:44.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25eb20a061356442d4a1c711818ce2e5848c382d 2024-05-04T07:46:44.684 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d', 'tag': None, 'wait_for_package': False} 2024-05-04T07:46:44.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25eb20a061356442d4a1c711818ce2e5848c382d 2024-05-04T07:46:44.844 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/ 2024-05-04T07:46:44.845 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3500.g25eb20a0 2024-05-04T07:46:44.860 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/ 2024-05-04T07:46:44.860 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3500.g25eb20a0 2024-05-04T07:46:45.097 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-04T07:46:45.098 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:46:45.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-04T07:46:45.172 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240503.134948/25eb20a061356442d4a1c711818ce2e5848c382d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-04T07:46:45.172 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:46:45.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-04T07:46:45.187 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-04T07:46:45.187 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25eb20a061356442d4a1c711818ce2e5848c382d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-04T07:46:45.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-04T07:46:45.261 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25eb20a061356442d4a1c711818ce2e5848c382d/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-04T07:46:45.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-04T07:46:45.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-04T07:46:45.430 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-04T07:46:45.502 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-04T07:46:45.510 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-05-04T07:46:45.514 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-05-04T07:46:45.582 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-05-04T07:46:45.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-05-04T07:46:45.837 INFO:teuthology.orchestra.run.smithi136.stdout:50 files removed 2024-05-04T07:46:45.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-04T07:46:45.904 INFO:teuthology.orchestra.run.smithi142.stdout:50 files removed 2024-05-04T07:46:45.942 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-04T07:46:47.262 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 89 kB/s | 84 kB 00:00 2024-05-04T07:46:47.473 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 75 kB/s | 84 kB 00:01 2024-05-04T07:46:48.063 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-05-04T07:46:48.419 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 14 kB/s | 12 kB 00:00 2024-05-04T07:46:49.072 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-05-04T07:46:49.216 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-05-04T07:46:51.704 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-05-04T07:46:53.862 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-05-04T07:46:53.897 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.0 MB 00:04 2024-05-04T07:46:57.856 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-05-04T07:46:58.819 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.2 MB 00:01 2024-05-04T07:47:00.373 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 16 kB 00:00 2024-05-04T07:47:01.374 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-05-04T07:47:02.596 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.2 MB 00:00 2024-05-04T07:47:04.476 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-04T07:47:06.473 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-04T07:47:07.315 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-04T07:47:09.683 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T07:47:09.685 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T07:47:09.706 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-04T07:47:09.707 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-04T07:47:09.708 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-04T07:47:09.709 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T07:47:09.712 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-04T07:47:09.715 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-04T07:47:09.716 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-04T07:47:09.786 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 6.6 k 2024-05-04T07:47:09.809 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 5.4 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 890 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 145 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 1.5 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 142 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 3.5 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 7.4 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 49 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 11 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 49 M 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 273 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 763 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 225 k 2024-05-04T07:47:09.810 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 27 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 18 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 32 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 746 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 126 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-04T07:47:09.811 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 161 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 320 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 298 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 99 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 85 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.1 M 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 170 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.4 M 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.1 M 2024-05-04T07:47:09.812 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 21 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 34 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 2.4 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 274 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 4.7 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 17 M 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 16 k 2024-05-04T07:47:09.813 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 25 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 163 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-04T07:47:09.814 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 502 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 5.4 M 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-04T07:47:09.815 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 45 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 135 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-04T07:47:09.816 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-04T07:47:09.817 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-04T07:47:09.818 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-04T07:47:09.819 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-04T07:47:09.820 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-04T07:47:09.821 INFO:teuthology.orchestra.run.smithi136.stdout:Install 148 Packages 2024-05-04T07:47:09.822 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 4 Packages 2024-05-04T07:47:09.822 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:47:09.822 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 222 M 2024-05-04T07:47:09.822 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-05-04T07:47:10.942 INFO:teuthology.orchestra.run.smithi136.stdout:(1/152): ceph-19.0.0-3500.g25eb20a0.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-04T07:47:11.334 INFO:teuthology.orchestra.run.smithi136.stdout:(2/152): ceph-base-19.0.0-3500.g25eb20a0.el9.x8 8.2 MB/s | 5.4 MB 00:00 2024-05-04T07:47:11.376 INFO:teuthology.orchestra.run.smithi136.stdout:(3/152): ceph-fuse-19.0.0-3500.g25eb20a0.el9.x8 2.0 MB/s | 890 kB 00:00 2024-05-04T07:47:11.409 INFO:teuthology.orchestra.run.smithi136.stdout:(4/152): ceph-immutable-object-cache-19.0.0-350 1.9 MB/s | 145 kB 00:00 2024-05-04T07:47:11.551 INFO:teuthology.orchestra.run.smithi136.stdout:(5/152): ceph-mgr-19.0.0-3500.g25eb20a0.el9.x86 11 MB/s | 1.5 MB 00:00 2024-05-04T07:47:11.860 INFO:teuthology.orchestra.run.smithi136.stdout:(6/152): ceph-mon-19.0.0-3500.g25eb20a0.el9.x86 15 MB/s | 4.7 MB 00:00 2024-05-04T07:47:12.019 INFO:teuthology.orchestra.run.smithi136.stdout:(7/152): ceph-mds-19.0.0-3500.g25eb20a0.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-05-04T07:47:12.369 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-04T07:47:12.919 INFO:teuthology.orchestra.run.smithi136.stdout:(8/152): ceph-osd-19.0.0-3500.g25eb20a0.el9.x86 16 MB/s | 17 MB 00:01 2024-05-04T07:47:12.977 INFO:teuthology.orchestra.run.smithi136.stdout:(9/152): ceph-selinux-19.0.0-3500.g25eb20a0.el9 439 kB/s | 25 kB 00:00 2024-05-04T07:47:14.369 INFO:teuthology.orchestra.run.smithi136.stdout:(10/152): ceph-common-19.0.0-3500.g25eb20a0.el9 5.7 MB/s | 21 MB 00:03 2024-05-04T07:47:14.445 INFO:teuthology.orchestra.run.smithi136.stdout:(11/152): cephfs-mirror-19.0.0-3500.g25eb20a0.e 3.0 MB/s | 225 kB 00:00 2024-05-04T07:47:14.511 INFO:teuthology.orchestra.run.smithi136.stdout:(12/152): cephfs-shell-19.0.0-3500.g25eb20a0.el 410 kB/s | 27 kB 00:00 2024-05-04T07:47:14.587 INFO:teuthology.orchestra.run.smithi136.stdout:(13/152): libcephfs-devel-19.0.0-3500.g25eb20a0 427 kB/s | 32 kB 00:00 2024-05-04T07:47:14.754 INFO:teuthology.orchestra.run.smithi136.stdout:(14/152): ceph-radosgw-19.0.0-3500.g25eb20a0.el 3.9 MB/s | 11 MB 00:02 2024-05-04T07:47:14.762 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T07:47:14.763 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T07:47:14.783 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-04T07:47:14.784 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-04T07:47:14.785 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-04T07:47:14.787 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T07:47:14.789 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-04T07:47:14.793 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-04T07:47:14.794 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-04T07:47:14.813 INFO:teuthology.orchestra.run.smithi136.stdout:(15/152): libcephfs2-19.0.0-3500.g25eb20a0.el9. 3.2 MB/s | 746 kB 00:00 2024-05-04T07:47:14.846 INFO:teuthology.orchestra.run.smithi136.stdout:(16/152): libcephsqlite-19.0.0-3500.g25eb20a0.e 1.8 MB/s | 163 kB 00:00 2024-05-04T07:47:14.864 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-05-04T07:47:14.883 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-05-04T07:47:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-05-04T07:47:14.883 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-05-04T07:47:14.883 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-05-04T07:47:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 6.6 k 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 5.4 M 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 890 k 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 145 k 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 1.5 M 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 142 k 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 3.5 M 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 7.4 M 2024-05-04T07:47:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 49 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 11 M 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 49 M 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 273 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 763 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 225 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 27 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 18 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 32 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 746 k 2024-05-04T07:47:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 126 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 161 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 320 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 298 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 99 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 85 k 2024-05-04T07:47:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.1 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 170 k 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.4 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 3.1 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 21 M 2024-05-04T07:47:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 34 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 2.4 M 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 274 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 4.7 M 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 17 M 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3500.g25eb20a0.el9 ceph-noarch 16 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 25 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-04T07:47:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 163 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 502 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 5.4 M 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-04T07:47:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-04T07:47:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 45 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-3500.g25eb20a0.el9 ceph 135 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-04T07:47:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-04T07:47:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-04T07:47:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-04T07:47:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-04T07:47:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-05-04T07:47:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout:Install 148 Packages 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 4 Packages 2024-05-04T07:47:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:47:14.898 INFO:teuthology.orchestra.run.smithi136.stdout:(17/152): librados-devel-19.0.0-3500.g25eb20a0. 1.7 MB/s | 126 kB 00:00 2024-05-04T07:47:14.898 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 222 M 2024-05-04T07:47:14.898 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-05-04T07:47:15.005 INFO:teuthology.orchestra.run.smithi136.stdout:(18/152): libradosstriper1-19.0.0-3500.g25eb20a 3.1 MB/s | 502 kB 00:00 2024-05-04T07:47:15.089 INFO:teuthology.orchestra.run.smithi136.stdout:(19/152): python3-ceph-argparse-19.0.0-3500.g25 550 kB/s | 45 kB 00:00 2024-05-04T07:47:15.181 INFO:teuthology.orchestra.run.smithi136.stdout:(20/152): python3-ceph-common-19.0.0-3500.g25eb 1.5 MB/s | 135 kB 00:00 2024-05-04T07:47:15.281 INFO:teuthology.orchestra.run.smithi136.stdout:(21/152): python3-cephfs-19.0.0-3500.g25eb20a0. 1.6 MB/s | 161 kB 00:00 2024-05-04T07:47:15.390 INFO:teuthology.orchestra.run.smithi136.stdout:(22/152): librgw2-19.0.0-3500.g25eb20a0.el9.x86 11 MB/s | 5.4 MB 00:00 2024-05-04T07:47:15.431 INFO:teuthology.orchestra.run.smithi136.stdout:(23/152): python3-rados-19.0.0-3500.g25eb20a0.e 2.1 MB/s | 320 kB 00:00 2024-05-04T07:47:15.474 INFO:teuthology.orchestra.run.smithi136.stdout:(24/152): python3-rbd-19.0.0-3500.g25eb20a0.el9 3.5 MB/s | 298 kB 00:00 2024-05-04T07:47:15.507 INFO:teuthology.orchestra.run.smithi136.stdout:(25/152): python3-rgw-19.0.0-3500.g25eb20a0.el9 1.3 MB/s | 99 kB 00:00 2024-05-04T07:47:15.549 INFO:teuthology.orchestra.run.smithi136.stdout:(26/152): rbd-fuse-19.0.0-3500.g25eb20a0.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-04T07:47:15.624 INFO:teuthology.orchestra.run.smithi136.stdout:(27/152): rbd-nbd-19.0.0-3500.g25eb20a0.el9.x86 2.3 MB/s | 170 kB 00:00 2024-05-04T07:47:15.708 INFO:teuthology.orchestra.run.smithi136.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3500.g 415 kB/s | 34 kB 00:00 2024-05-04T07:47:15.792 INFO:teuthology.orchestra.run.smithi136.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3500.g25eb20a 1.7 MB/s | 142 kB 00:00 2024-05-04T07:47:16.137 INFO:teuthology.orchestra.run.smithi142.stdout:(1/152): ceph-19.0.0-3500.g25eb20a0.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-04T07:47:16.158 INFO:teuthology.orchestra.run.smithi136.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3500.g25eb2 9.7 MB/s | 3.5 MB 00:00 2024-05-04T07:47:16.462 INFO:teuthology.orchestra.run.smithi142.stdout:(2/152): ceph-fuse-19.0.0-3500.g25eb20a0.el9.x8 2.7 MB/s | 890 kB 00:00 2024-05-04T07:47:16.529 INFO:teuthology.orchestra.run.smithi142.stdout:(3/152): ceph-immutable-object-cache-19.0.0-350 2.2 MB/s | 145 kB 00:00 2024-05-04T07:47:16.659 INFO:teuthology.orchestra.run.smithi136.stdout:(31/152): ceph-test-19.0.0-3500.g25eb20a0.el9.x 13 MB/s | 49 MB 00:03 2024-05-04T07:47:16.760 INFO:teuthology.orchestra.run.smithi136.stdout:(32/152): rbd-mirror-19.0.0-3500.g25eb20a0.el9. 2.5 MB/s | 3.1 MB 00:01 2024-05-04T07:47:16.793 INFO:teuthology.orchestra.run.smithi136.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3500.g25 2.0 MB/s | 274 kB 00:00 2024-05-04T07:47:16.852 INFO:teuthology.orchestra.run.smithi136.stdout:(34/152): ceph-mgr-rook-19.0.0-3500.g25eb20a0.e 543 kB/s | 49 kB 00:00 2024-05-04T07:47:16.877 INFO:teuthology.orchestra.run.smithi136.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3500.g2 199 kB/s | 16 kB 00:00 2024-05-04T07:47:17.102 INFO:teuthology.orchestra.run.smithi136.stdout:(36/152): ceph-volume-19.0.0-3500.g25eb20a0.el9 1.1 MB/s | 273 kB 00:00 2024-05-04T07:47:17.153 INFO:teuthology.orchestra.run.smithi136.stdout:(37/152): cephadm-19.0.0-3500.g25eb20a0.el9.noa 2.7 MB/s | 763 kB 00:00 2024-05-04T07:47:17.205 INFO:teuthology.orchestra.run.smithi142.stdout:(4/152): ceph-base-19.0.0-3500.g25eb20a0.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-05-04T07:47:17.206 INFO:teuthology.orchestra.run.smithi136.stdout:(38/152): cephfs-top-19.0.0-3500.g25eb20a0.el9. 245 kB/s | 18 kB 00:00 2024-05-04T07:47:17.246 INFO:teuthology.orchestra.run.smithi142.stdout:(5/152): ceph-mds-19.0.0-3500.g25eb20a0.el9.x86 3.3 MB/s | 2.4 MB 00:00 2024-05-04T07:47:17.311 INFO:teuthology.orchestra.run.smithi136.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 6.4 MB/s | 7.4 MB 00:01 2024-05-04T07:47:17.363 INFO:teuthology.orchestra.run.smithi142.stdout:(6/152): ceph-mgr-19.0.0-3500.g25eb20a0.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-05-04T07:47:17.420 INFO:teuthology.orchestra.run.smithi136.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 302 kB/s | 80 kB 00:00 2024-05-04T07:47:17.512 INFO:teuthology.orchestra.run.smithi136.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 980 kB/s | 195 kB 00:00 2024-05-04T07:47:17.546 INFO:teuthology.orchestra.run.smithi136.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-05-04T07:47:17.596 INFO:teuthology.orchestra.run.smithi136.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-05-04T07:47:17.630 INFO:teuthology.orchestra.run.smithi136.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-05-04T07:47:17.663 INFO:teuthology.orchestra.run.smithi136.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-04T07:47:17.697 INFO:teuthology.orchestra.run.smithi136.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-04T07:47:17.730 INFO:teuthology.orchestra.run.smithi136.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-04T07:47:17.781 INFO:teuthology.orchestra.run.smithi136.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-05-04T07:47:17.914 INFO:teuthology.orchestra.run.smithi136.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-05-04T07:47:17.940 INFO:teuthology.orchestra.run.smithi136.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 678 kB/s | 107 kB 00:00 2024-05-04T07:47:17.965 INFO:teuthology.orchestra.run.smithi136.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 434 kB/s | 21 kB 00:00 2024-05-04T07:47:18.024 INFO:teuthology.orchestra.run.smithi136.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-05-04T07:47:18.049 INFO:teuthology.orchestra.run.smithi136.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 396 kB/s | 33 kB 00:00 2024-05-04T07:47:18.091 INFO:teuthology.orchestra.run.smithi136.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-05-04T07:47:18.116 INFO:teuthology.orchestra.run.smithi136.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-05-04T07:47:18.142 INFO:teuthology.orchestra.run.smithi136.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 225 kB/s | 11 kB 00:00 2024-05-04T07:47:18.175 INFO:teuthology.orchestra.run.smithi136.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-04T07:47:18.201 INFO:teuthology.orchestra.run.smithi136.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 780 kB/s | 45 kB 00:00 2024-05-04T07:47:18.251 INFO:teuthology.orchestra.run.smithi136.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-05-04T07:47:18.263 INFO:teuthology.orchestra.run.smithi142.stdout:(7/152): ceph-mon-19.0.0-3500.g25eb20a0.el9.x86 4.6 MB/s | 4.7 MB 00:01 2024-05-04T07:47:18.301 INFO:teuthology.orchestra.run.smithi136.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-05-04T07:47:18.318 INFO:teuthology.orchestra.run.smithi136.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 384 kB/s | 25 kB 00:00 2024-05-04T07:47:18.346 INFO:teuthology.orchestra.run.smithi136.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-04T07:47:18.377 INFO:teuthology.orchestra.run.smithi136.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-04T07:47:18.411 INFO:teuthology.orchestra.run.smithi136.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-04T07:47:18.428 INFO:teuthology.orchestra.run.smithi136.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 712 kB/s | 35 kB 00:00 2024-05-04T07:47:18.528 INFO:teuthology.orchestra.run.smithi136.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-05-04T07:47:18.629 INFO:teuthology.orchestra.run.smithi136.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-04T07:47:18.664 INFO:teuthology.orchestra.run.smithi142.stdout:(8/152): ceph-osd-19.0.0-3500.g25eb20a0.el9.x86 13 MB/s | 17 MB 00:01 2024-05-04T07:47:18.704 INFO:teuthology.orchestra.run.smithi136.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-04T07:47:18.730 INFO:teuthology.orchestra.run.smithi142.stdout:(9/152): ceph-selinux-19.0.0-3500.g25eb20a0.el9 384 kB/s | 25 kB 00:00 2024-05-04T07:47:18.813 INFO:teuthology.orchestra.run.smithi136.stdout:(69/152): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-05-04T07:47:18.896 INFO:teuthology.orchestra.run.smithi136.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 4.4 MB 00:00 2024-05-04T07:47:18.921 INFO:teuthology.orchestra.run.smithi136.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 615 kB/s | 133 kB 00:00 2024-05-04T07:47:18.963 INFO:teuthology.orchestra.run.smithi136.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-04T07:47:19.005 INFO:teuthology.orchestra.run.smithi136.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-05-04T07:47:19.055 INFO:teuthology.orchestra.run.smithi136.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-05-04T07:47:19.106 INFO:teuthology.orchestra.run.smithi136.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-04T07:47:19.139 INFO:teuthology.orchestra.run.smithi136.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 782 kB/s | 26 kB 00:00 2024-05-04T07:47:19.181 INFO:teuthology.orchestra.run.smithi136.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 469 kB/s | 19 kB 00:00 2024-05-04T07:47:19.232 INFO:teuthology.orchestra.run.smithi136.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-04T07:47:19.349 INFO:teuthology.orchestra.run.smithi136.stdout:(79/152): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-05-04T07:47:19.374 INFO:teuthology.orchestra.run.smithi136.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 245 kB/s | 35 kB 00:00 2024-05-04T07:47:19.424 INFO:teuthology.orchestra.run.smithi136.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-05-04T07:47:19.541 INFO:teuthology.orchestra.run.smithi136.stdout:(82/152): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-05-04T07:47:19.578 INFO:teuthology.orchestra.run.smithi136.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-05-04T07:47:19.592 INFO:teuthology.orchestra.run.smithi136.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-04T07:47:19.617 INFO:teuthology.orchestra.run.smithi136.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-05-04T07:47:19.651 INFO:teuthology.orchestra.run.smithi136.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-04T07:47:19.710 INFO:teuthology.orchestra.run.smithi136.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-04T07:47:19.743 INFO:teuthology.orchestra.run.smithi136.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-05-04T07:47:19.769 INFO:teuthology.orchestra.run.smithi136.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 882 kB/s | 51 kB 00:00 2024-05-04T07:47:19.794 INFO:teuthology.orchestra.run.smithi136.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-04T07:47:19.836 INFO:teuthology.orchestra.run.smithi136.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-04T07:47:19.856 INFO:teuthology.orchestra.run.smithi142.stdout:(10/152): ceph-common-19.0.0-3500.g25eb20a0.el9 5.2 MB/s | 21 MB 00:04 2024-05-04T07:47:19.878 INFO:teuthology.orchestra.run.smithi136.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.1 MB/s | 44 kB 00:00 2024-05-04T07:47:19.928 INFO:teuthology.orchestra.run.smithi136.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.4 MB/s | 221 kB 00:00 2024-05-04T07:47:19.956 INFO:teuthology.orchestra.run.smithi142.stdout:(11/152): cephfs-mirror-19.0.0-3500.g25eb20a0.e 2.2 MB/s | 225 kB 00:00 2024-05-04T07:47:20.006 INFO:teuthology.orchestra.run.smithi142.stdout:(12/152): cephfs-shell-19.0.0-3500.g25eb20a0.el 554 kB/s | 27 kB 00:00 2024-05-04T07:47:20.028 INFO:teuthology.orchestra.run.smithi136.stdout:(94/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-05-04T07:47:20.054 INFO:teuthology.orchestra.run.smithi136.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 288 kB/s | 36 kB 00:00 2024-05-04T07:47:20.079 INFO:teuthology.orchestra.run.smithi136.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-05-04T07:47:20.113 INFO:teuthology.orchestra.run.smithi136.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-04T07:47:20.138 INFO:teuthology.orchestra.run.smithi136.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-04T07:47:20.163 INFO:teuthology.orchestra.run.smithi136.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-05-04T07:47:20.189 INFO:teuthology.orchestra.run.smithi136.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-04T07:47:20.214 INFO:teuthology.orchestra.run.smithi136.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-05-04T07:47:20.248 INFO:teuthology.orchestra.run.smithi136.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 386 kB/s | 22 kB 00:00 2024-05-04T07:47:20.382 INFO:teuthology.orchestra.run.smithi142.stdout:(13/152): ceph-radosgw-19.0.0-3500.g25eb20a0.el 5.0 MB/s | 11 MB 00:02 2024-05-04T07:47:20.407 INFO:teuthology.orchestra.run.smithi142.stdout:(14/152): libcephfs-devel-19.0.0-3500.g25eb20a0 79 kB/s | 32 kB 00:00 2024-05-04T07:47:20.423 INFO:teuthology.orchestra.run.smithi136.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.1 MB/s | 863 kB 00:00 2024-05-04T07:47:20.490 INFO:teuthology.orchestra.run.smithi142.stdout:(15/152): libcephsqlite-19.0.0-3500.g25eb20a0.e 1.9 MB/s | 163 kB 00:00 2024-05-04T07:47:20.549 INFO:teuthology.orchestra.run.smithi142.stdout:(16/152): libcephfs2-19.0.0-3500.g25eb20a0.el9. 4.4 MB/s | 746 kB 00:00 2024-05-04T07:47:20.582 INFO:teuthology.orchestra.run.smithi142.stdout:(17/152): librados-devel-19.0.0-3500.g25eb20a0. 1.4 MB/s | 126 kB 00:00 2024-05-04T07:47:20.657 INFO:teuthology.orchestra.run.smithi136.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-05-04T07:47:20.699 INFO:teuthology.orchestra.run.smithi142.stdout:(18/152): libradosstriper1-19.0.0-3500.g25eb20a 3.3 MB/s | 502 kB 00:00 2024-05-04T07:47:20.765 INFO:teuthology.orchestra.run.smithi136.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-04T07:47:20.766 INFO:teuthology.orchestra.run.smithi142.stdout:(19/152): python3-ceph-argparse-19.0.0-3500.g25 688 kB/s | 45 kB 00:00 2024-05-04T07:47:20.799 INFO:teuthology.orchestra.run.smithi136.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 823 kB/s | 309 kB 00:00 2024-05-04T07:47:20.824 INFO:teuthology.orchestra.run.smithi136.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 118 kB/s | 19 kB 00:00 2024-05-04T07:47:20.833 INFO:teuthology.orchestra.run.smithi142.stdout:(20/152): python3-ceph-common-19.0.0-3500.g25eb 2.0 MB/s | 135 kB 00:00 2024-05-04T07:47:20.909 INFO:teuthology.orchestra.run.smithi142.stdout:(21/152): python3-cephfs-19.0.0-3500.g25eb20a0. 2.1 MB/s | 161 kB 00:00 2024-05-04T07:47:20.966 INFO:teuthology.orchestra.run.smithi136.stdout:(108/152): libarrow-9.0.0-11.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-05-04T07:47:20.991 INFO:teuthology.orchestra.run.smithi136.stdout:(109/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 171 kB/s | 26 kB 00:00 2024-05-04T07:47:21.016 INFO:teuthology.orchestra.run.smithi136.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 275 kB/s | 49 kB 00:00 2024-05-04T07:47:21.042 INFO:teuthology.orchestra.run.smithi142.stdout:(22/152): python3-rados-19.0.0-3500.g25eb20a0.e 2.4 MB/s | 320 kB 00:00 2024-05-04T07:47:21.067 INFO:teuthology.orchestra.run.smithi136.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-05-04T07:47:21.100 INFO:teuthology.orchestra.run.smithi136.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-04T07:47:21.142 INFO:teuthology.orchestra.run.smithi136.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 839 kB 00:00 2024-05-04T07:47:21.167 INFO:teuthology.orchestra.run.smithi142.stdout:(23/152): python3-rbd-19.0.0-3500.g25eb20a0.el9 2.4 MB/s | 298 kB 00:00 2024-05-04T07:47:21.192 INFO:teuthology.orchestra.run.smithi136.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-04T07:47:21.218 INFO:teuthology.orchestra.run.smithi136.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 626 kB/s | 43 kB 00:00 2024-05-04T07:47:21.234 INFO:teuthology.orchestra.run.smithi142.stdout:(24/152): python3-rgw-19.0.0-3500.g25eb20a0.el9 1.5 MB/s | 99 kB 00:00 2024-05-04T07:47:21.243 INFO:teuthology.orchestra.run.smithi136.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 341 kB/s | 32 kB 00:00 2024-05-04T07:47:21.269 INFO:teuthology.orchestra.run.smithi136.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-05-04T07:47:21.301 INFO:teuthology.orchestra.run.smithi142.stdout:(25/152): rbd-fuse-19.0.0-3500.g25eb20a0.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-04T07:47:21.302 INFO:teuthology.orchestra.run.smithi136.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-04T07:47:21.336 INFO:teuthology.orchestra.run.smithi136.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.9 MB/s | 358 kB 00:00 2024-05-04T07:47:21.369 INFO:teuthology.orchestra.run.smithi136.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.1 MB/s | 303 kB 00:00 2024-05-04T07:47:21.394 INFO:teuthology.orchestra.run.smithi136.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 644 kB/s | 35 kB 00:00 2024-05-04T07:47:21.420 INFO:teuthology.orchestra.run.smithi136.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.5 MB/s | 206 kB 00:00 2024-05-04T07:47:21.511 INFO:teuthology.orchestra.run.smithi136.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-05-04T07:47:21.537 INFO:teuthology.orchestra.run.smithi136.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-04T07:47:21.560 INFO:teuthology.orchestra.run.smithi142.stdout:(26/152): librgw2-19.0.0-3500.g25eb20a0.el9.x86 5.5 MB/s | 5.4 MB 00:00 2024-05-04T07:47:21.562 INFO:teuthology.orchestra.run.smithi136.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 84 kB/s | 11 kB 00:00 2024-05-04T07:47:21.587 INFO:teuthology.orchestra.run.smithi136.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 240 kB/s | 18 kB 00:00 2024-05-04T07:47:21.613 INFO:teuthology.orchestra.run.smithi136.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 473 kB/s | 23 kB 00:00 2024-05-04T07:47:21.638 INFO:teuthology.orchestra.run.smithi136.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 263 kB/s | 19 kB 00:00 2024-05-04T07:47:21.663 INFO:teuthology.orchestra.run.smithi136.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-05-04T07:47:21.713 INFO:teuthology.orchestra.run.smithi136.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-05-04T07:47:21.738 INFO:teuthology.orchestra.run.smithi136.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 468 kB/s | 46 kB 00:00 2024-05-04T07:47:21.764 INFO:teuthology.orchestra.run.smithi136.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 882 kB/s | 79 kB 00:00 2024-05-04T07:47:21.797 INFO:teuthology.orchestra.run.smithi136.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2024-05-04T07:47:21.823 INFO:teuthology.orchestra.run.smithi136.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-04T07:47:21.848 INFO:teuthology.orchestra.run.smithi136.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-05-04T07:47:21.873 INFO:teuthology.orchestra.run.smithi136.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-04T07:47:21.898 INFO:teuthology.orchestra.run.smithi136.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 382 kB/s | 28 kB 00:00 2024-05-04T07:47:21.924 INFO:teuthology.orchestra.run.smithi136.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 418 kB/s | 31 kB 00:00 2024-05-04T07:47:21.957 INFO:teuthology.orchestra.run.smithi136.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-05-04T07:47:21.991 INFO:teuthology.orchestra.run.smithi136.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 653 kB/s | 59 kB 00:00 2024-05-04T07:47:22.016 INFO:teuthology.orchestra.run.smithi136.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 401 kB/s | 36 kB 00:00 2024-05-04T07:47:22.050 INFO:teuthology.orchestra.run.smithi136.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 890 kB/s | 51 kB 00:00 2024-05-04T07:47:22.069 INFO:teuthology.orchestra.run.smithi142.stdout:(27/152): ceph-test-19.0.0-3500.g25eb20a0.el9.x 15 MB/s | 49 MB 00:03 2024-05-04T07:47:22.075 INFO:teuthology.orchestra.run.smithi136.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-04T07:47:22.100 INFO:teuthology.orchestra.run.smithi136.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-04T07:47:22.102 INFO:teuthology.orchestra.run.smithi142.stdout:(28/152): rbd-nbd-19.0.0-3500.g25eb20a0.el9.x86 315 kB/s | 170 kB 00:00 2024-05-04T07:47:22.134 INFO:teuthology.orchestra.run.smithi136.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.3 MB/s | 427 kB 00:00 2024-05-04T07:47:22.152 INFO:teuthology.orchestra.run.smithi142.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3500.g 415 kB/s | 34 kB 00:00 2024-05-04T07:47:22.159 INFO:teuthology.orchestra.run.smithi136.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 243 kB/s | 20 kB 00:00 2024-05-04T07:47:22.186 INFO:teuthology.orchestra.run.smithi142.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3500.g25eb20a 1.7 MB/s | 142 kB 00:00 2024-05-04T07:47:22.193 INFO:teuthology.orchestra.run.smithi136.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-05-04T07:47:22.286 INFO:teuthology.orchestra.run.smithi142.stdout:(31/152): rbd-mirror-19.0.0-3500.g25eb20a0.el9. 3.1 MB/s | 3.1 MB 00:00 2024-05-04T07:47:22.343 INFO:teuthology.orchestra.run.smithi136.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-05-04T07:47:22.445 INFO:teuthology.orchestra.run.smithi142.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3500.g25 1.7 MB/s | 274 kB 00:00 2024-05-04T07:47:22.562 INFO:teuthology.orchestra.run.smithi142.stdout:(33/152): ceph-mgr-dashboard-19.0.0-3500.g25eb2 8.7 MB/s | 3.5 MB 00:00 2024-05-04T07:47:22.587 INFO:teuthology.orchestra.run.smithi142.stdout:(34/152): ceph-mgr-rook-19.0.0-3500.g25eb20a0.e 350 kB/s | 49 kB 00:00 2024-05-04T07:47:22.594 INFO:teuthology.orchestra.run.smithi136.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-04T07:47:22.629 INFO:teuthology.orchestra.run.smithi142.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3500.g2 249 kB/s | 16 kB 00:00 2024-05-04T07:47:22.688 INFO:teuthology.orchestra.run.smithi142.stdout:(36/152): ceph-volume-19.0.0-3500.g25eb20a0.el9 2.7 MB/s | 273 kB 00:00 2024-05-04T07:47:22.746 INFO:teuthology.orchestra.run.smithi142.stdout:(37/152): cephadm-19.0.0-3500.g25eb20a0.el9.noa 6.4 MB/s | 763 kB 00:00 2024-05-04T07:47:22.752 INFO:teuthology.orchestra.run.smithi136.stdout:(150/152): librbd1-19.0.0-3500.g25eb20a0.el9.x8 5.8 MB/s | 3.1 MB 00:00 2024-05-04T07:47:22.771 INFO:teuthology.orchestra.run.smithi142.stdout:(38/152): cephfs-top-19.0.0-3500.g25eb20a0.el9. 219 kB/s | 18 kB 00:00 2024-05-04T07:47:22.902 INFO:teuthology.orchestra.run.smithi136.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.8 MB/s | 2.4 MB 00:00 2024-05-04T07:47:23.094 INFO:teuthology.orchestra.run.smithi136.stdout:(152/152): librados2-19.0.0-3500.g25eb20a0.el9. 3.6 MB/s | 3.4 MB 00:00 2024-05-04T07:47:23.102 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-05-04T07:47:23.103 INFO:teuthology.orchestra.run.smithi136.stdout:Total 17 MB/s | 222 MB 00:13 2024-05-04T07:47:23.269 INFO:teuthology.orchestra.run.smithi142.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 6.8 MB/s | 7.4 MB 00:01 2024-05-04T07:47:23.697 INFO:teuthology.orchestra.run.smithi142.stdout:(40/152): fuse-2.9.9-15.el9.x86_64.rpm 85 kB/s | 80 kB 00:00 2024-05-04T07:47:24.064 INFO:teuthology.orchestra.run.smithi142.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 622 kB/s | 803 kB 00:01 2024-05-04T07:47:24.222 INFO:teuthology.orchestra.run.smithi142.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 206 kB/s | 195 kB 00:00 2024-05-04T07:47:24.814 INFO:teuthology.orchestra.run.smithi142.stdout:(43/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 227 kB/s | 253 kB 00:01 2024-05-04T07:47:25.181 INFO:teuthology.orchestra.run.smithi142.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 111 kB/s | 106 kB 00:00 2024-05-04T07:47:25.306 INFO:teuthology.orchestra.run.smithi142.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 1.0 MB/s | 1.2 MB 00:01 2024-05-04T07:47:25.740 INFO:teuthology.orchestra.run.smithi142.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 146 kB/s | 135 kB 00:00 2024-05-04T07:47:25.962 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-05-04T07:47:26.141 INFO:teuthology.orchestra.run.smithi142.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 130 kB/s | 125 kB 00:00 2024-05-04T07:47:26.194 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-05-04T07:47:26.194 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-05-04T07:47:26.349 INFO:teuthology.orchestra.run.smithi142.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 206 kB/s | 215 kB 00:01 2024-05-04T07:47:26.508 INFO:teuthology.orchestra.run.smithi142.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 899 kB/s | 689 kB 00:00 2024-05-04T07:47:26.616 INFO:teuthology.orchestra.run.smithi142.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 200 kB/s | 21 kB 00:00 2024-05-04T07:47:26.742 INFO:teuthology.orchestra.run.smithi142.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-05-04T07:47:26.850 INFO:teuthology.orchestra.run.smithi142.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 304 kB/s | 33 kB 00:00 2024-05-04T07:47:26.876 INFO:teuthology.orchestra.run.smithi142.stdout:(53/152): boost-program-options-1.75.0-8.el9.x8 203 kB/s | 107 kB 00:00 2024-05-04T07:47:26.942 INFO:teuthology.orchestra.run.smithi142.stdout:(54/152): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-05-04T07:47:26.984 INFO:teuthology.orchestra.run.smithi142.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 169 kB/s | 18 kB 00:00 2024-05-04T07:47:27.060 INFO:teuthology.orchestra.run.smithi142.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 96 kB/s | 11 kB 00:00 2024-05-04T07:47:27.168 INFO:teuthology.orchestra.run.smithi142.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 420 kB/s | 45 kB 00:00 2024-05-04T07:47:27.193 INFO:teuthology.orchestra.run.smithi142.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 769 kB/s | 160 kB 00:00 2024-05-04T07:47:27.285 INFO:teuthology.orchestra.run.smithi142.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-05-04T07:47:27.377 INFO:teuthology.orchestra.run.smithi142.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-05-04T07:47:27.422 INFO:teuthology.orchestra.run.smithi142.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 187 kB/s | 25 kB 00:00 2024-05-04T07:47:27.486 INFO:teuthology.orchestra.run.smithi142.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 439 kB/s | 47 kB 00:00 2024-05-04T07:47:27.544 INFO:teuthology.orchestra.run.smithi142.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 1.6 MB/s | 582 kB 00:00 2024-05-04T07:47:27.595 INFO:teuthology.orchestra.run.smithi142.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-04T07:47:27.654 INFO:teuthology.orchestra.run.smithi142.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-05-04T07:47:27.871 INFO:teuthology.orchestra.run.smithi142.stdout:(66/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 654 kB/s | 292 kB 00:00 2024-05-04T07:47:28.784 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-05-04T07:47:28.785 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-05-04T07:47:29.421 INFO:teuthology.orchestra.run.smithi142.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-05-04T07:47:29.563 INFO:teuthology.orchestra.run.smithi142.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 962 kB/s | 1.6 MB 00:01 2024-05-04T07:47:29.704 INFO:teuthology.orchestra.run.smithi142.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 945 kB/s | 133 kB 00:00 2024-05-04T07:47:30.513 INFO:teuthology.orchestra.run.smithi142.stdout:(70/152): openblas-openmp-0.3.21-2.el9.x86_64.r 1.6 MB/s | 4.7 MB 00:02 2024-05-04T07:47:30.713 INFO:teuthology.orchestra.run.smithi142.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 706 kB/s | 911 kB 00:01 2024-05-04T07:47:30.897 INFO:teuthology.orchestra.run.smithi142.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 478 kB/s | 87 kB 00:00 2024-05-04T07:47:31.980 INFO:teuthology.orchestra.run.smithi142.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 705 kB/s | 1.0 MB 00:01 2024-05-04T07:47:32.339 INFO:teuthology.orchestra.run.smithi142.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 682 kB/s | 244 kB 00:00 2024-05-04T07:47:32.714 INFO:teuthology.orchestra.run.smithi142.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 663 kB/s | 248 kB 00:00 2024-05-04T07:47:32.822 INFO:teuthology.orchestra.run.smithi142.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-05-04T07:47:32.931 INFO:teuthology.orchestra.run.smithi142.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 178 kB/s | 19 kB 00:00 2024-05-04T07:47:33.206 INFO:teuthology.orchestra.run.smithi142.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 627 kB/s | 172 kB 00:00 2024-05-04T07:47:33.337 INFO:teuthology.orchestra.run.smithi142.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 267 kB/s | 35 kB 00:00 2024-05-04T07:47:35.024 INFO:teuthology.orchestra.run.smithi142.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 1.1 MB/s | 5.8 MB 00:05 2024-05-04T07:47:35.274 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-05-04T07:47:35.367 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-04T07:47:35.374 INFO:teuthology.orchestra.run.smithi142.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 717 kB/s | 250 kB 00:00 2024-05-04T07:47:35.450 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-04T07:47:35.732 INFO:teuthology.orchestra.run.smithi142.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 621 kB/s | 222 kB 00:00 2024-05-04T07:47:35.733 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-04T07:47:35.866 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-04T07:47:35.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-04T07:47:35.916 INFO:teuthology.orchestra.run.smithi142.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 422 kB/s | 77 kB 00:00 2024-05-04T07:47:36.024 INFO:teuthology.orchestra.run.smithi142.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 392 kB/s | 42 kB 00:00 2024-05-04T07:47:36.045 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-04T07:47:36.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-04T07:47:36.533 INFO:teuthology.orchestra.run.smithi142.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 530 kB/s | 269 kB 00:00 2024-05-04T07:47:36.584 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:47:36.759 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:47:36.794 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:47:36.800 INFO:teuthology.orchestra.run.smithi142.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 597 kB/s | 159 kB 00:00 2024-05-04T07:47:36.918 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:47:36.951 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 10/156 2024-05-04T07:47:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 644 kB/s | 279 kB 00:00 2024-05-04T07:47:37.278 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-04T07:47:37.340 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-04T07:47:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 474 kB/s | 51 kB 00:00 2024-05-04T07:47:37.365 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:47:37.451 INFO:teuthology.orchestra.run.smithi142.stdout:(89/152): python3-requests-oauthlib-1.3.0-12.el 498 kB/s | 54 kB 00:00 2024-05-04T07:47:37.513 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:47:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 14/156 2024-05-04T07:47:37.663 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 14/156 2024-05-04T07:47:37.692 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-04T07:47:37.765 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-04T07:47:38.063 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-04T07:47:38.118 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-04T07:47:38.313 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-04T07:47:38.359 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-04T07:47:38.412 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/156 2024-05-04T07:47:38.554 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/156 2024-05-04T07:47:38.605 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/156 2024-05-04T07:47:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/156 2024-05-04T07:47:38.727 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/156 2024-05-04T07:47:38.767 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/156 2024-05-04T07:47:38.894 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/156 2024-05-04T07:47:38.943 INFO:teuthology.orchestra.run.smithi142.stdout:(90/152): python3-babel-2.9.1-2.el9.noarch.rpm 759 kB/s | 6.0 MB 00:08 2024-05-04T07:47:38.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/156 2024-05-04T07:47:39.007 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/156 2024-05-04T07:47:39.051 INFO:teuthology.orchestra.run.smithi142.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 388 kB/s | 42 kB 00:00 2024-05-04T07:47:39.066 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/156 2024-05-04T07:47:39.174 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/156 2024-05-04T07:47:39.185 INFO:teuthology.orchestra.run.smithi142.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 333 kB/s | 44 kB 00:00 2024-05-04T07:47:39.214 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9. 30/156 2024-05-04T07:47:39.263 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el 31/156 2024-05-04T07:47:39.295 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_6 32/156 2024-05-04T07:47:39.404 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/156 2024-05-04T07:47:39.473 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/156 2024-05-04T07:47:39.535 INFO:teuthology.orchestra.run.smithi142.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 632 kB/s | 221 kB 00:00 2024-05-04T07:47:39.570 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/156 2024-05-04T07:47:39.636 INFO:teuthology.orchestra.run.smithi142.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 361 kB/s | 36 kB 00:00 2024-05-04T07:47:39.736 INFO:teuthology.orchestra.run.smithi142.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 478 kB/s | 47 kB 00:00 2024-05-04T07:47:39.736 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/156 2024-05-04T07:47:39.810 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/156 2024-05-04T07:47:40.169 INFO:teuthology.orchestra.run.smithi142.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 704 kB/s | 305 kB 00:00 2024-05-04T07:47:40.286 INFO:teuthology.orchestra.run.smithi142.stdout:(97/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 751 kB/s | 5.1 MB 00:06 2024-05-04T07:47:40.306 INFO:teuthology.orchestra.run.smithi142.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 435 kB/s | 58 kB 00:00 2024-05-04T07:47:40.479 INFO:teuthology.orchestra.run.smithi142.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 491 kB/s | 94 kB 00:00 2024-05-04T07:47:40.486 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/156 2024-05-04T07:47:40.504 INFO:teuthology.orchestra.run.smithi142.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 319 kB/s | 64 kB 00:00 2024-05-04T07:47:40.590 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/156 2024-05-04T07:47:40.629 INFO:teuthology.orchestra.run.smithi142.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 300 kB/s | 45 kB 00:00 2024-05-04T07:47:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/156 2024-05-04T07:47:40.654 INFO:teuthology.orchestra.run.smithi142.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 149 kB/s | 22 kB 00:00 2024-05-04T07:47:40.771 INFO:teuthology.orchestra.run.smithi142.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-05-04T07:47:40.795 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/156 2024-05-04T07:47:40.813 INFO:teuthology.orchestra.run.smithi142.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-05-04T07:47:40.847 INFO:teuthology.orchestra.run.smithi142.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 4.1 MB/s | 309 kB 00:00 2024-05-04T07:47:40.853 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_6 42/156 2024-05-04T07:47:40.889 INFO:teuthology.orchestra.run.smithi142.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 262 kB/s | 19 kB 00:00 2024-05-04T07:47:40.931 INFO:teuthology.orchestra.run.smithi142.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 635 kB/s | 26 kB 00:00 2024-05-04T07:47:40.934 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/156 2024-05-04T07:47:40.989 INFO:teuthology.orchestra.run.smithi142.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 845 kB/s | 49 kB 00:00 2024-05-04T07:47:41.081 INFO:teuthology.orchestra.run.smithi142.stdout:(109/152): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-05-04T07:47:41.107 INFO:teuthology.orchestra.run.smithi142.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 578 kB/s | 67 kB 00:00 2024-05-04T07:47:41.140 INFO:teuthology.orchestra.run.smithi142.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-05-04T07:47:41.167 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/156 2024-05-04T07:47:41.190 INFO:teuthology.orchestra.run.smithi142.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-05-04T07:47:41.233 INFO:teuthology.orchestra.run.smithi142.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 839 kB 00:00 2024-05-04T07:47:41.257 INFO:teuthology.orchestra.run.smithi142.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 658 kB/s | 43 kB 00:00 2024-05-04T07:47:41.263 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 45/156 2024-05-04T07:47:41.283 INFO:teuthology.orchestra.run.smithi142.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 653 kB/s | 32 kB 00:00 2024-05-04T07:47:41.308 INFO:teuthology.orchestra.run.smithi142.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2024-05-04T07:47:41.367 INFO:teuthology.orchestra.run.smithi142.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-04T07:47:41.392 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/156 2024-05-04T07:47:41.400 INFO:teuthology.orchestra.run.smithi142.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-05-04T07:47:41.434 INFO:teuthology.orchestra.run.smithi142.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-05-04T07:47:41.459 INFO:teuthology.orchestra.run.smithi142.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 610 kB/s | 35 kB 00:00 2024-05-04T07:47:41.467 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 47/156 2024-05-04T07:47:41.493 INFO:teuthology.orchestra.run.smithi142.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-05-04T07:47:41.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-04T07:47:41.606 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-04T07:47:41.644 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-04T07:47:41.711 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-04T07:47:41.727 INFO:teuthology.orchestra.run.smithi142.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 621 kB/s | 144 kB 00:00 2024-05-04T07:47:41.760 INFO:teuthology.orchestra.run.smithi142.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 330 kB/s | 11 kB 00:00 2024-05-04T07:47:41.762 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-04T07:47:41.794 INFO:teuthology.orchestra.run.smithi142.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 545 kB/s | 18 kB 00:00 2024-05-04T07:47:41.825 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-04T07:47:41.861 INFO:teuthology.orchestra.run.smithi142.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-05-04T07:47:41.886 INFO:teuthology.orchestra.run.smithi142.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 254 kB/s | 23 kB 00:00 2024-05-04T07:47:41.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-04T07:47:41.911 INFO:teuthology.orchestra.run.smithi142.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-05-04T07:47:41.936 INFO:teuthology.orchestra.run.smithi142.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 398 kB/s | 20 kB 00:00 2024-05-04T07:47:41.970 INFO:teuthology.orchestra.run.smithi142.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-05-04T07:47:42.020 INFO:teuthology.orchestra.run.smithi142.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-05-04T07:47:42.046 INFO:teuthology.orchestra.run.smithi142.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-04T07:47:42.071 INFO:teuthology.orchestra.run.smithi142.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-04T07:47:42.085 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-04T07:47:42.121 INFO:teuthology.orchestra.run.smithi142.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-05-04T07:47:42.146 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-04T07:47:42.147 INFO:teuthology.orchestra.run.smithi142.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 220 kB/s | 16 kB 00:00 2024-05-04T07:47:42.171 INFO:teuthology.orchestra.run.smithi142.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-04T07:47:42.180 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-04T07:47:42.197 INFO:teuthology.orchestra.run.smithi142.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 573 kB/s | 28 kB 00:00 2024-05-04T07:47:42.222 INFO:teuthology.orchestra.run.smithi142.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 621 kB/s | 31 kB 00:00 2024-05-04T07:47:42.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-04T07:47:42.256 INFO:teuthology.orchestra.run.smithi142.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-05-04T07:47:42.281 INFO:teuthology.orchestra.run.smithi142.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-04T07:47:42.298 INFO:teuthology.orchestra.run.smithi142.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 864 kB/s | 36 kB 00:00 2024-05-04T07:47:42.323 INFO:teuthology.orchestra.run.smithi142.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-05-04T07:47:42.357 INFO:teuthology.orchestra.run.smithi142.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-05-04T07:47:42.366 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-04T07:47:42.382 INFO:teuthology.orchestra.run.smithi142.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-04T07:47:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-04T07:47:42.416 INFO:teuthology.orchestra.run.smithi142.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-05-04T07:47:42.441 INFO:teuthology.orchestra.run.smithi142.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2024-05-04T07:47:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-04T07:47:42.486 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-04T07:47:42.491 INFO:teuthology.orchestra.run.smithi142.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-04T07:47:42.520 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-04T07:47:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-04T07:47:42.706 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-04T07:47:42.877 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-04T07:47:42.935 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-04T07:47:43.006 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-04T07:47:43.047 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-04T07:47:43.117 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-04T07:47:43.179 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-04T07:47:43.200 INFO:teuthology.orchestra.run.smithi142.stdout:(148/152): librbd1-19.0.0-3500.g25eb20a0.el9.x8 5.0 MB/s | 3.1 MB 00:00 2024-05-04T07:47:43.220 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-04T07:47:43.268 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-04T07:47:43.317 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-04T07:47:43.393 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-04T07:47:43.426 INFO:teuthology.orchestra.run.smithi142.stdout:(149/152): librados2-19.0.0-3500.g25eb20a0.el9. 3.6 MB/s | 3.4 MB 00:00 2024-05-04T07:47:43.441 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-04T07:47:43.580 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-04T07:47:43.654 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-04T07:47:43.708 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-04T07:47:43.779 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-04T07:47:43.922 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-04T07:47:43.987 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-04T07:47:44.534 INFO:teuthology.orchestra.run.smithi142.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 1.0 MB/s | 1.3 MB 00:01 2024-05-04T07:47:44.817 INFO:teuthology.orchestra.run.smithi142.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.7 MB/s | 2.4 MB 00:01 2024-05-04T07:47:44.931 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-04T07:47:44.987 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-04T07:47:45.037 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-04T07:47:45.162 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-04T07:47:45.223 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-04T07:47:45.320 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-04T07:47:45.355 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-04T07:47:45.582 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-04T07:47:45.611 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-04T07:47:45.727 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-04T07:47:46.550 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-04T07:47:46.699 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-04T07:47:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-04T07:47:48.406 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-04T07:47:48.453 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-04T07:47:48.498 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-04T07:47:48.904 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-04T07:47:48.947 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 99/156 2024-05-04T07:47:49.071 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 99/156 2024-05-04T07:47:49.105 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 100/156 2024-05-04T07:47:49.163 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-04T07:47:49.743 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-04T07:47:49.784 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 103/156 2024-05-04T07:47:49.885 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 103/156 2024-05-04T07:47:49.911 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 104/156 2024-05-04T07:47:52.639 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:47:52.905 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:47:53.590 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:47:53.638 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 106/156 2024-05-04T07:47:53.800 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 106/156 2024-05-04T07:47:53.800 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-04T07:47:53.801 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-04T07:47:53.801 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:47:53.853 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 107/156 2024-05-04T07:47:59.416 INFO:teuthology.orchestra.run.smithi142.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 758 kB/s | 16 MB 00:21 2024-05-04T07:47:59.423 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-05-04T07:47:59.424 INFO:teuthology.orchestra.run.smithi142.stdout:Total 5.0 MB/s | 222 MB 00:44 2024-05-04T07:48:02.291 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-05-04T07:48:02.524 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-05-04T07:48:02.524 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-05-04T07:48:05.032 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-05-04T07:48:05.034 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 107/156 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-05-04T07:48:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:06.829 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 108/156 2024-05-04T07:48:06.868 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 108/156 2024-05-04T07:48:06.868 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:06.868 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-04T07:48:06.868 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:08.482 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 109/156 2024-05-04T07:48:08.580 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 109/156 2024-05-04T07:48:08.580 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:08.580 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-04T07:48:08.580 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T07:48:08.581 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T07:48:08.581 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:08.840 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 110/156 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 110/156 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T07:48:08.931 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:09.424 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 111/156 2024-05-04T07:48:09.514 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 111/156 2024-05-04T07:48:09.514 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:09.514 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-04T07:48:09.514 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T07:48:09.514 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T07:48:09.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:09.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-04T07:48:09.712 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-04T07:48:09.788 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-04T07:48:10.017 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-04T07:48:10.078 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-04T07:48:10.163 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-04T07:48:10.264 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-04T07:48:10.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-04T07:48:10.477 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-04T07:48:10.522 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-04T07:48:10.560 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-04T07:48:11.201 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 123/156 2024-05-04T07:48:11.236 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 123/156 2024-05-04T07:48:11.307 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.e 124/156 2024-05-04T07:48:11.420 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0. 125/156 2024-05-04T07:48:11.464 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 126/156 2024-05-04T07:48:11.528 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-05-04T07:48:11.666 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-04T07:48:11.754 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-04T07:48:11.874 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-04T07:48:11.925 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-04T07:48:11.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-04T07:48:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-04T07:48:12.550 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-04T07:48:12.647 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:48:12.756 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 126/156 2024-05-04T07:48:12.799 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 127/156 2024-05-04T07:48:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:48:12.881 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:48:13.012 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:48:13.056 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 10/156 2024-05-04T07:48:13.388 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-04T07:48:13.444 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-04T07:48:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:48:13.672 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:48:13.703 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 14/156 2024-05-04T07:48:13.799 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 14/156 2024-05-04T07:48:13.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-04T07:48:13.890 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 127/156 2024-05-04T07:48:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-04T07:48:13.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 128/156 2024-05-04T07:48:14.068 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 128/156 2024-05-04T07:48:14.224 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-04T07:48:14.254 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el 129/156 2024-05-04T07:48:14.292 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 130/156 2024-05-04T07:48:14.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-04T07:48:14.359 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 130/156 2024-05-04T07:48:14.360 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:14.360 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-04T07:48:14.360 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T07:48:14.360 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T07:48:14.360 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:14.418 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 131/156 2024-05-04T07:48:14.456 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 131/156 2024-05-04T07:48:14.506 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-04T07:48:14.553 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-04T07:48:14.608 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/156 2024-05-04T07:48:14.610 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 132/156 2024-05-04T07:48:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 133/156 2024-05-04T07:48:14.753 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/156 2024-05-04T07:48:14.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/156 2024-05-04T07:48:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/156 2024-05-04T07:48:14.925 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/156 2024-05-04T07:48:14.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/156 2024-05-04T07:48:15.115 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/156 2024-05-04T07:48:15.187 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/156 2024-05-04T07:48:15.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/156 2024-05-04T07:48:15.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/156 2024-05-04T07:48:15.374 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/156 2024-05-04T07:48:15.415 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9. 30/156 2024-05-04T07:48:15.462 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el 31/156 2024-05-04T07:48:15.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_6 32/156 2024-05-04T07:48:15.604 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/156 2024-05-04T07:48:15.657 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/156 2024-05-04T07:48:15.701 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-04T07:48:15.757 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 135/156 2024-05-04T07:48:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/156 2024-05-04T07:48:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 135/156 2024-05-04T07:48:15.826 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:15.826 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-04T07:48:15.826 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T07:48:15.826 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T07:48:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:15.879 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 136/156 2024-05-04T07:48:15.937 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/156 2024-05-04T07:48:15.976 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 136/156 2024-05-04T07:48:15.976 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:15.976 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-04T07:48:15.976 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:16.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/156 2024-05-04T07:48:16.055 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 137/156 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 137/156 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T07:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:16.522 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 138/156 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 138/156 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T07:48:16.613 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:16.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/156 2024-05-04T07:48:16.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/156 2024-05-04T07:48:16.819 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/156 2024-05-04T07:48:16.865 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/156 2024-05-04T07:48:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_6 42/156 2024-05-04T07:48:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/156 2024-05-04T07:48:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/156 2024-05-04T07:48:17.355 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 45/156 2024-05-04T07:48:17.490 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/156 2024-05-04T07:48:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 47/156 2024-05-04T07:48:17.671 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-04T07:48:17.714 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-04T07:48:17.751 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-04T07:48:17.817 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-04T07:48:17.861 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-04T07:48:17.921 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-04T07:48:17.981 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-04T07:48:18.183 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-04T07:48:18.233 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-04T07:48:18.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-04T07:48:18.326 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-04T07:48:18.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-04T07:48:18.504 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-04T07:48:18.552 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-04T07:48:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-04T07:48:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-04T07:48:18.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-04T07:48:19.001 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-04T07:48:19.051 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-04T07:48:19.098 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-04T07:48:19.147 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-04T07:48:19.237 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-04T07:48:19.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-04T07:48:19.346 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-04T07:48:19.392 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-04T07:48:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-04T07:48:19.518 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-04T07:48:19.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-04T07:48:19.724 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-04T07:48:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-04T07:48:19.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-04T07:48:19.908 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-04T07:48:20.072 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-04T07:48:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-04T07:48:21.096 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-04T07:48:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-04T07:48:21.184 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-04T07:48:21.305 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-04T07:48:21.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-04T07:48:21.514 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-04T07:48:21.560 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-04T07:48:21.647 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 139/156 2024-05-04T07:48:21.704 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 140/156 2024-05-04T07:48:21.796 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 141/156 2024-05-04T07:48:21.797 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-04T07:48:21.832 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-04T07:48:21.842 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-04T07:48:21.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-04T07:48:21.957 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-04T07:48:22.207 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 144/156 2024-05-04T07:48:22.257 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-04T07:48:22.286 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_ 146/156 2024-05-04T07:48:22.772 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-04T07:48:22.911 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-04T07:48:23.248 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:48:23.300 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:48:23.360 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:48:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-04T07:48:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-04T07:48:24.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-04T07:48:24.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-04T07:48:24.721 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 148/156 2024-05-04T07:48:24.823 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-04T07:48:24.891 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-04T07:48:25.052 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-04T07:48:25.075 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-04T07:48:25.103 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-04T07:48:25.104 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-04T07:48:25.116 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 99/156 2024-05-04T07:48:25.228 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-04T07:48:25.269 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-04T07:48:25.269 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-04T07:48:25.271 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 99/156 2024-05-04T07:48:25.306 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 100/156 2024-05-04T07:48:25.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-04T07:48:25.393 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-04T07:48:25.523 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:48:25.833 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:48:25.833 INFO:teuthology.orchestra.run.smithi136.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-04T07:48:25.833 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:25.890 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-04T07:48:25.919 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 103/156 2024-05-04T07:48:26.045 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 103/156 2024-05-04T07:48:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 104/156 2024-05-04T07:48:28.790 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:48:28.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:48:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 105/156 2024-05-04T07:48:29.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 106/156 2024-05-04T07:48:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 106/156 2024-05-04T07:48:29.697 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-04T07:48:29.697 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-04T07:48:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:29.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 107/156 2024-05-04T07:48:31.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 1/156 2024-05-04T07:48:31.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 2/156 2024-05-04T07:48:31.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 3/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 4/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 5/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 6/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 7/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 10/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 11/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 12/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 14/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_ 15/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 16/156 2024-05-04T07:48:31.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 17/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_6 18/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 19/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 20/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el 21/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9. 22/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_6 23/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 24/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 25/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 26/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 27/156 2024-05-04T07:48:31.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 28/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 29/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0. 30/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 31/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 32/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 33/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el 34/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 35/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.e 36/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 37/156 2024-05-04T07:48:31.677 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 38/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 39/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-04T07:48:31.678 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-04T07:48:31.679 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-04T07:48:31.680 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-04T07:48:31.681 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-04T07:48:31.682 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-04T07:48:31.683 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-04T07:48:31.684 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 149/156 2024-05-04T07:48:31.685 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-04T07:48:31.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 151/156 2024-05-04T07:48:31.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-04T07:48:31.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-04T07:48:31.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-04T07:48:31.686 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-04T07:48:34.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.091 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.092 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-04T07:48:34.093 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.094 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-04T07:48:34.095 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.14-1.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.096 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-04T07:48:34.097 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-04T07:48:34.098 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-04T07:48:34.099 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-04T07:48:34.100 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-3.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-04T07:48:34.101 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-04T07:48:34.102 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-04T07:48:34.102 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-04T07:48:34.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:48:34.102 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-05-04T07:48:34.706 DEBUG:teuthology.parallel:result is None 2024-05-04T07:48:42.704 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 107/156 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-05-04T07:48:42.705 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:42.975 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 108/156 2024-05-04T07:48:43.023 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 108/156 2024-05-04T07:48:43.023 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:43.023 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-04T07:48:43.023 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:44.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 109/156 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 109/156 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T07:48:44.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:45.028 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 110/156 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 110/156 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T07:48:45.106 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 111/156 2024-05-04T07:48:45.678 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 111/156 2024-05-04T07:48:45.678 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:45.678 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-04T07:48:45.679 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T07:48:45.679 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T07:48:45.679 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-04T07:48:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-04T07:48:45.983 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-04T07:48:46.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-04T07:48:46.304 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-04T07:48:46.396 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-04T07:48:46.518 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-04T07:48:46.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-04T07:48:46.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-04T07:48:46.783 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-04T07:48:46.822 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-04T07:48:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 123/156 2024-05-04T07:48:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 123/156 2024-05-04T07:48:47.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.e 124/156 2024-05-04T07:48:47.606 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0. 125/156 2024-05-04T07:48:47.635 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 126/156 2024-05-04T07:48:48.947 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 126/156 2024-05-04T07:48:48.989 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 127/156 2024-05-04T07:48:50.089 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 127/156 2024-05-04T07:48:50.120 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 128/156 2024-05-04T07:48:50.277 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 128/156 2024-05-04T07:48:50.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el 129/156 2024-05-04T07:48:50.497 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 130/156 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 130/156 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T07:48:50.568 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:50.639 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 131/156 2024-05-04T07:48:50.676 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 131/156 2024-05-04T07:48:50.787 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 132/156 2024-05-04T07:48:50.877 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 133/156 2024-05-04T07:48:51.903 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-04T07:48:51.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 135/156 2024-05-04T07:48:52.029 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 135/156 2024-05-04T07:48:52.030 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:52.030 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-04T07:48:52.030 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T07:48:52.030 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T07:48:52.030 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:52.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 136/156 2024-05-04T07:48:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 136/156 2024-05-04T07:48:52.157 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:52.157 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-04T07:48:52.157 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:52.226 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 137/156 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 137/156 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T07:48:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:52.687 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 138/156 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 138/156 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T07:48:52.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:48:57.852 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 139/156 2024-05-04T07:48:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 140/156 2024-05-04T07:48:58.026 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 141/156 2024-05-04T07:48:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-04T07:48:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-04T07:48:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 144/156 2024-05-04T07:48:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-04T07:48:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_ 146/156 2024-05-04T07:48:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:48:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:48:59.485 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-04T07:49:00.839 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 148/156 2024-05-04T07:49:00.942 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-04T07:49:01.015 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-04T07:49:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-04T07:49:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-04T07:49:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-04T07:49:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-04T07:49:01.449 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-04T07:49:01.450 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-04T07:49:01.589 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-04T07:49:01.720 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:49:02.017 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:49:02.017 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-04T07:49:02.018 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 1/156 2024-05-04T07:49:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 2/156 2024-05-04T07:49:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 3/156 2024-05-04T07:49:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 4/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3500.g25eb2 5/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 6/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 7/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 8/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 9/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 10/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 11/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 12/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 13/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 14/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_ 15/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 16/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 17/156 2024-05-04T07:49:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_6 18/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86 19/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 20/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el 21/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9. 22/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_6 23/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 24/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 25/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 26/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 27/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 28/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 29/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0. 30/156 2024-05-04T07:49:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noa 31/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.n 32/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3500.g25e 33/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el 34/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 35/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.e 36/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 37/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 38/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 39/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-04T07:49:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-04T07:49:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-04T07:49:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-04T07:49:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-04T07:49:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-04T07:49:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-04T07:49:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-04T07:49:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 149/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 151/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-04T07:49:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-04T07:49:07.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-04T07:49:10.047 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-04T07:49:10.047 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:10.047 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-05-04T07:49:10.047 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.047 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.048 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.049 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-3500.g25eb20a0.el9.noarch 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-04T07:49:10.050 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.051 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-04T07:49:10.052 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.14-1.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-04T07:49:10.054 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-04T07:49:10.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-04T07:49:10.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-04T07:49:10.057 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-3500.g25eb20a0.el9.x86_64 2024-05-04T07:49:10.058 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:10.059 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-05-04T07:49:10.705 DEBUG:teuthology.parallel:result is None 2024-05-04T07:49:10.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25eb20a061356442d4a1c711818ce2e5848c382d 2024-05-04T07:49:10.853 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-04T07:49:10.927 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-3500.g25eb20a0.el9 2024-05-04T07:49:10.928 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3500.g25eb20a0.el9 2024-05-04T07:49:10.928 INFO:teuthology.task.install:The correct ceph version 19.0.0-3500.g25eb20a0 is installed. 2024-05-04T07:49:10.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25eb20a061356442d4a1c711818ce2e5848c382d 2024-05-04T07:49:11.155 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-04T07:49:11.212 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-3500.g25eb20a0.el9 2024-05-04T07:49:11.212 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3500.g25eb20a0.el9 2024-05-04T07:49:11.212 INFO:teuthology.task.install:The correct ceph version 19.0.0-3500.g25eb20a0 is installed. 2024-05-04T07:49:11.214 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-04T07:49:11.215 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:11.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T07:49:11.306 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:11.306 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T07:49:11.394 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-04T07:49:11.394 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:11.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T07:49:11.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T07:49:11.567 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:11.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T07:49:11.649 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T07:49:11.711 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-04T07:49:11.711 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:11.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T07:49:11.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T07:49:11.932 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:11.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T07:49:12.009 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T07:49:12.117 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-04T07:49:12.118 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:12.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T07:49:12.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T07:49:12.293 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:12.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T07:49:12.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T07:49:12.471 INFO:teuthology.run_tasks:Running task ceph... 2024-05-04T07:49:12.560 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-04T07:49:12.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-05-04T07:49:12.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-05-04T07:49:12.649 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-04T07:49:12.649 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T07:49:12.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T07:49:12.730 INFO:tasks.ceph:Creating extra log directories... 2024-05-04T07:49:12.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T07:49:12.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T07:49:12.814 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-04T07:49:12.814 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-04T07:49:12.815 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-04T07:49:12.815 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:12.815 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T07:49:12.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:13.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:13.191 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:13.191 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T07:49:13.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:13.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:13.507 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-04T07:49:13.508 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-04T07:49:13.508 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555', 'branch': 'wip-rishabh-testing-20240503.134948', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls}', 'email': None, 'first_in_suite': False, 'job_id': '7690555', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240503.134948'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240503.134948', 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2794, 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d', 'sleep_before_teardown': 0, 'subset': '509/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240503.134948', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_25eb20a061356442d4a1c711818ce2e5848c382d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '25eb20a061356442d4a1c711818ce2e5848c382d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQriPLX4c3SiOqgiZMjYHb4G+KMEsi/NxqVdmgoVCaKzVpZREii2n1ZJMbBDC/eb+npKopW3fQD1xiE6eah0Qs=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXBZkzWTE/wrx1tZLb5+b+NI6Ozf9lAMzfpTF93/t4EnogP61iUJTNK3AEezIwJIA16lnQZ2WfzQpzk0pnUtJg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '25eb20a061356442d4a1c711818ce2e5848c382d', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-04_04:44:58', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-04T07:49:13.508 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T07:49:13.516 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T07:49:13.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T07:49:13.574 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T07:49:13.661 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:13.661 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T07:49:13.715 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T07:49:13.715 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-05-04T07:49:13.764 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T07:49:13.764 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:13.764 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-04 07:48:26.304393663 +0000 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-04 07:46:14.814357841 +0000 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-04 07:46:14.814357841 +0000 2024-05-04T07:49:13.765 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-04 07:46:14.814357841 +0000 2024-05-04T07:49:13.765 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T07:49:13.846 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-04T07:49:13.846 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-04T07:49:13.846 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000358548 s, 1.4 MB/s 2024-05-04T07:49:13.850 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T07:49:13.902 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-05-04T07:49:13.947 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-04 07:48:26.305393641 +0000 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-04 07:46:15.436344049 +0000 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-04 07:46:15.436344049 +0000 2024-05-04T07:49:13.948 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-04 07:46:15.436344049 +0000 2024-05-04T07:49:13.948 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T07:49:14.069 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-04T07:49:14.069 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-04T07:49:14.069 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000381929 s, 1.3 MB/s 2024-05-04T07:49:14.073 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T07:49:14.129 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-04 07:48:26.306393619 +0000 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-04 07:46:16.043330590 +0000 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-04 07:46:16.043330590 +0000 2024-05-04T07:49:14.181 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-04 07:46:16.043330590 +0000 2024-05-04T07:49:14.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T07:49:14.261 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-04T07:49:14.261 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-04T07:49:14.261 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000339294 s, 1.5 MB/s 2024-05-04T07:49:14.265 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T07:49:14.322 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-04 07:48:26.307393597 +0000 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-04 07:46:16.814313495 +0000 2024-05-04T07:49:14.373 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-04 07:46:16.814313495 +0000 2024-05-04T07:49:14.374 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-04 07:46:16.814313495 +0000 2024-05-04T07:49:14.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T07:49:14.446 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-04T07:49:14.446 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-04T07:49:14.446 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000344802 s, 1.5 MB/s 2024-05-04T07:49:14.449 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T07:49:14.503 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:14.504 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:14.504 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T07:49:14.545 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T07:49:14.546 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-05-04T07:49:14.627 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-05-04 07:49:02.468323940 +0000 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-05-04 07:46:15.094849771 +0000 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-05-04 07:46:15.094849771 +0000 2024-05-04T07:49:14.628 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-05-04 07:46:15.094849771 +0000 2024-05-04T07:49:14.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T07:49:14.731 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-05-04T07:49:14.732 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-05-04T07:49:14.732 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000428296 s, 1.2 MB/s 2024-05-04T07:49:14.734 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T07:49:14.776 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-05-04 07:49:02.469323922 +0000 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-05-04 07:46:15.688838849 +0000 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-05-04 07:46:15.688838849 +0000 2024-05-04T07:49:14.858 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-05-04 07:46:15.688838849 +0000 2024-05-04T07:49:14.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T07:49:14.960 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-05-04T07:49:14.991 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-05-04T07:49:14.992 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000286122 s, 1.8 MB/s 2024-05-04T07:49:14.993 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T07:49:15.041 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-05-04T07:49:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T07:49:15.126 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:15.126 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-04T07:49:15.126 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:15.127 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:15.127 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-05-04 07:49:02.469323922 +0000 2024-05-04T07:49:15.127 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-05-04 07:46:16.276828038 +0000 2024-05-04T07:49:15.127 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-05-04 07:46:16.276828038 +0000 2024-05-04T07:49:15.127 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-05-04 07:46:16.276828038 +0000 2024-05-04T07:49:15.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T07:49:15.233 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-05-04T07:49:15.233 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-05-04T07:49:15.233 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000355315 s, 1.4 MB/s 2024-05-04T07:49:15.236 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T07:49:15.280 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-05-04 07:49:02.470323903 +0000 2024-05-04T07:49:15.364 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-05-04 07:46:16.846817559 +0000 2024-05-04T07:49:15.365 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-05-04 07:46:16.846817559 +0000 2024-05-04T07:49:15.365 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-05-04 07:46:16.846817559 +0000 2024-05-04T07:49:15.365 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T07:49:15.466 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-05-04T07:49:15.467 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-05-04T07:49:15.467 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000290653 s, 1.8 MB/s 2024-05-04T07:49:15.470 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T07:49:15.517 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:15.517 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T07:49:15.517 INFO:tasks.ceph:Generating config... 2024-05-04T07:49:15.518 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-04T07:49:15.519 INFO:tasks.ceph:[client] debug client = 20 2024-05-04T07:49:15.519 INFO:tasks.ceph:[client] debug ms = 1 2024-05-04T07:49:15.519 INFO:tasks.ceph:[client] pid file = 2024-05-04T07:49:15.519 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-04T07:49:15.519 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-04T07:49:15.519 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-04T07:49:15.519 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-04T07:49:15.520 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-04T07:49:15.520 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-04T07:49:15.520 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-04T07:49:15.520 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-04T07:49:15.520 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-04T07:49:15.521 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-04T07:49:15.521 INFO:tasks.ceph:Setting up mon.a... 2024-05-04T07:49:15.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-04T07:49:15.663 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.keyring 2024-05-04T07:49:15.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-04T07:49:15.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T07:49:15.865 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.136'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-05-04T07:49:15.866 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.136,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-04T07:49:15.867 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:15.867 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T07:49:15.917 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.136 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:16.069 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: generated fsid 9ecc10c5-f8dd-4dd0-88f7-548a507c724d 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:setting min_mon_release = quincy 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:epoch 0 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:fsid 9ecc10c5-f8dd-4dd0-88f7-548a507c724d 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:last_changed 2024-05-04T07:49:16.070038+0000 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:created 2024-05-04T07:49:16.070038+0000 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:min_mon_release 17 (quincy) 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:election_strategy: 1 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:0: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.a 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-05-04T07:49:16.070 INFO:teuthology.orchestra.run.smithi136.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-04T07:49:16.073 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T07:49:16.123 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9ecc10c5-f8dd-4dd0-88f7-548a507c724d... 2024-05-04T07:49:16.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T07:49:16.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-05-04T07:49:16.253 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-05-04T07:49:16.254 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-05-04T07:49:16.255 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.136,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 9ecc10c5-f8dd-4dd0-88f7-548a507c724d 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-05-04T07:49:16.256 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.257 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-05-04T07:49:16.258 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-05-04T07:49:16.259 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-05-04T07:49:16.260 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-05-04T07:49:16.261 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: mon down mkfs grace = 300 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-05-04T07:49:16.262 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-05-04T07:49:16.263 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T07:49:16.264 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-05-04T07:49:16.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T07:49:16.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.136,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 9ecc10c5-f8dd-4dd0-88f7-548a507c724d 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.267 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-05-04T07:49:16.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-05-04T07:49:16.269 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-05-04T07:49:16.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-05-04T07:49:16.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-05-04T07:49:16.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon down mkfs grace = 300 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-05-04T07:49:16.273 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-05-04T07:49:16.274 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-05-04T07:49:16.275 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-05-04T07:49:16.291 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-04T07:49:16.292 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-04T07:49:16.417 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-04T07:49:16.417 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:16.417 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-04T07:49:16.463 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:16.463 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-04T07:49:16.560 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:49:16.560 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:16.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T07:49:16.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T07:49:16.693 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:16.693 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:16.789 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:49:16.790 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:16.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T07:49:16.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T07:49:16.880 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:16.880 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:16.962 INFO:tasks.ceph:Setting up mon nodes... 2024-05-04T07:49:16.962 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-04T07:49:16.962 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T07:49:17.131 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T07:49:17.142 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T07:49:17.265 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T07:49:17.273 INFO:tasks.ceph:Setting up mds nodes... 2024-05-04T07:49:17.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T07:49:17.440 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T07:49:17.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-04T07:49:17.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T07:49:17.678 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T07:49:17.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-04T07:49:17.774 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T07:49:17.929 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T07:49:17.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-04T07:49:18.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T07:49:18.141 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T07:49:18.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-04T07:49:18.227 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-04T07:49:18.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-04T07:49:18.350 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-04T07:49:18.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-04T07:49:18.506 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-04T07:49:18.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-04T07:49:18.663 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-04T07:49:18.716 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-04T07:49:18.824 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-04T07:49:18.859 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-04T07:49:18.859 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T07:49:18.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-04T07:49:18.948 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:18.949 INFO:tasks.ceph:role: osd.0 2024-05-04T07:49:18.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:49:18.949 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T07:49:19.038 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:19.039 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:19.468 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-05-04T07:49:19.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-05-04T07:49:19.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-04T07:49:19.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-04T07:49:19.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-04T07:49:19.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:19.777 INFO:tasks.ceph:role: osd.1 2024-05-04T07:49:19.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:49:19.777 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T07:49:19.859 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:19.860 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:19.861 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:20.278 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-05-04T07:49:20.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-05-04T07:49:20.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-04T07:49:20.399 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-04T07:49:20.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-04T07:49:20.531 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:20.531 INFO:tasks.ceph:role: osd.2 2024-05-04T07:49:20.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:49:20.531 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:20.607 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:20.608 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:20.608 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:20.608 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:21.053 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-05-04T07:49:21.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-05-04T07:49:21.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-04T07:49:21.173 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-04T07:49:21.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-04T07:49:21.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:21.309 INFO:tasks.ceph:role: osd.3 2024-05-04T07:49:21.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:49:21.309 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T07:49:21.378 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:21.378 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:21.378 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:21.379 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:21.819 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-05-04T07:49:21.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-05-04T07:49:21.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-04T07:49:21.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-04T07:49:22.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:22.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.157+0000 7f990c144640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-04T07:49:22.159 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.159+0000 7f990c144640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-04T07:49:22.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.159+0000 7f990c144640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T07:49:22.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.159+0000 7f990c144640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T07:49:22.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.159+0000 7f990c144640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T07:49:22.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:22.162+0000 7f990c144640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-04T07:49:25.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-04T07:49:25.239 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:25.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.371+0000 7f2000032640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-04T07:49:25.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.371+0000 7f2000032640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-04T07:49:25.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.371+0000 7f2000032640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T07:49:25.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.371+0000 7f2000032640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T07:49:25.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.371+0000 7f2000032640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T07:49:25.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:25.374+0000 7f2000032640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-04T07:49:28.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-04T07:49:28.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:28.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.823+0000 7fb6b3a19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-04T07:49:28.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.824+0000 7fb6b3a19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-04T07:49:28.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.824+0000 7fb6b3a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T07:49:28.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.824+0000 7fb6b3a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T07:49:28.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.824+0000 7fb6b3a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T07:49:28.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:28.827+0000 7fb6b3a19640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-04T07:49:31.821 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-04T07:49:31.911 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:32.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.036+0000 7f294b355640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-04T07:49:32.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.037+0000 7f294b355640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-04T07:49:32.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.037+0000 7f294b355640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T07:49:32.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.037+0000 7f294b355640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T07:49:32.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.037+0000 7f294b355640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T07:49:32.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:32.039+0000 7f294b355640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-04T07:49:35.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-04T07:49:35.115 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-04T07:49:35.205 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:35.205 INFO:tasks.ceph:role: osd.4 2024-05-04T07:49:35.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:49:35.205 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T07:49:35.293 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:35.293 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:35.293 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:35.294 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:35.706 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-05-04T07:49:35.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-05-04T07:49:35.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-04T07:49:35.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-04T07:49:35.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-04T07:49:36.007 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:36.007 INFO:tasks.ceph:role: osd.5 2024-05-04T07:49:36.007 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:49:36.007 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T07:49:36.092 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:36.092 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:36.092 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:36.092 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:36.093 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:36.449 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-05-04T07:49:36.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-05-04T07:49:36.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-04T07:49:36.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-04T07:49:36.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-04T07:49:36.728 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:36.729 INFO:tasks.ceph:role: osd.6 2024-05-04T07:49:36.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:49:36.729 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T07:49:36.820 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:36.821 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-05-04T07:49:37.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-05-04T07:49:37.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-04T07:49:37.349 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-04T07:49:37.427 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-04T07:49:37.500 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T07:49:37.500 INFO:tasks.ceph:role: osd.7 2024-05-04T07:49:37.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:49:37.501 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T07:49:37.580 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T07:49:37.581 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T07:49:37.989 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-05-04T07:49:37.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-05-04T07:49:37.996 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-04T07:49:38.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-04T07:49:38.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:38.406 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.406+0000 7fcebcc10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-04T07:49:38.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.406+0000 7fcebcc10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-04T07:49:38.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.406+0000 7fcebcc10640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T07:49:38.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.406+0000 7fcebcc10640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T07:49:38.407 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.407+0000 7fcebcc10640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T07:49:38.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:38.410+0000 7fcebcc10640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-04T07:49:41.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-04T07:49:41.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:41.831 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.830+0000 7f6fef212640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-04T07:49:41.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.831+0000 7f6fef212640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-04T07:49:41.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.831+0000 7f6fef212640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T07:49:41.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.831+0000 7f6fef212640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T07:49:41.832 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.831+0000 7f6fef212640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T07:49:41.834 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:41.834+0000 7f6fef212640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-04T07:49:43.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:43.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:49:45.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-04T07:49:45.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:45.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.264+0000 7f7f4d218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-04T07:49:45.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.265+0000 7f7f4d218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-04T07:49:45.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.265+0000 7f7f4d218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T07:49:45.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.265+0000 7f7f4d218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T07:49:45.266 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.265+0000 7f7f4d218640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T07:49:45.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:45.268+0000 7f7f4d218640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-04T07:49:48.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-04T07:49:48.305 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:48.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.431+0000 7fe495d57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-04T07:49:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.431+0000 7fe495d57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-04T07:49:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.432+0000 7fe495d57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T07:49:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.432+0000 7fe495d57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T07:49:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.432+0000 7fe495d57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T07:49:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:49:48.434+0000 7fe495d57640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-04T07:49:51.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-04T07:49:51.484 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-04T07:49:51.485 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-04T07:49:51.578 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-04T07:49:51.660 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.660 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-04T07:49:51.745 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-04T07:49:51.830 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-04T07:49:51.958 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:51.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-04T07:49:52.038 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:52.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-04T07:49:52.123 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-04T07:49:52.210 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.210 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-04T07:49:52.294 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-04T07:49:52.376 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-04T07:49:52.460 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-04T07:49:52.545 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-04T07:49:52.629 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-04T07:49:52.709 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:52.709 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-04T07:49:52.767 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:49:52.767 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-04T07:49:52.818 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.818 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-04T07:49:52.875 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:49:52.875 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-04T07:49:52.926 INFO:tasks.ceph:Adding keys to all mons... 2024-05-04T07:49:52.926 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T07:49:52.934 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB96DVmuHncBxAAqi/WJT31GsWiRQJKaD6cew== 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB96DVmhzBFGhAAi/G1ikBeIqpbgG3mx7xw4Q== 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB96DVmHr99KBAAU5SsNIpIAmGXMdPrpblJPw== 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-05-04T07:49:53.010 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCC6DVmBaBqCRAAZipB2PO7F9Uq/424lbor7Q== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCF6DVmDuYqFhAAXHmV9OdDx7S3CGTUFUoycg== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCI6DVmr3wpMRAA8WvlS7mf6xywVPm9/8lN5A== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCM6DVmDQNIAhAAMJbQr/ophUcqRO1/o0AO6Q== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB96DVmBo7gDxAA1F6P45Zru000fSG4YE7Kgw== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB96DVmxHtvNxAAY+7wZItq12+lN/2kpvDHEg== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVmMClxCBAAJLrfauP23EeQ0I4xTqhNuA== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCS6DVmKYFFGBAAaMyQILM0gNcTjmjmeqei3w== 2024-05-04T07:49:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCV6DVm1+yVMRAAru8qg4gOWpFzwTMt9P+MbA== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCZ6DVmcpvaDxAAPZ5wNkmtOH5qzE73Wj0UlA== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCc6DVm4i3AGRAAjZBrRi8M+IUtdJHhtT/axQ== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVmlFbsFBAAIn9GcuvztIqP7lCKmms1KA== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVmyp46HhAAJFW41LvazXR78tAHZM5w0A== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVm5n2TJxAAq7XBFt6ZvbDe+L2s+/0r/g== 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2024-05-04T07:49:53.012 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVmq/EjMRAA1KezP1A0XAjO9mOc546eRA== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB96DVmuHncBxAAqi/WJT31GsWiRQJKaD6cew== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB96DVmhzBFGhAAi/G1ikBeIqpbgG3mx7xw4Q== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB96DVmHr99KBAAU5SsNIpIAmGXMdPrpblJPw== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCC6DVmBaBqCRAAZipB2PO7F9Uq/424lbor7Q== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCF6DVmDuYqFhAAXHmV9OdDx7S3CGTUFUoycg== 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-05-04T07:49:53.013 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCI6DVmr3wpMRAA8WvlS7mf6xywVPm9/8lN5A== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCM6DVmDQNIAhAAMJbQr/ophUcqRO1/o0AO6Q== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB96DVmBo7gDxAA1F6P45Zru000fSG4YE7Kgw== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB96DVmxHtvNxAAY+7wZItq12+lN/2kpvDHEg== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+6DVmMClxCBAAJLrfauP23EeQ0I4xTqhNuA== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCS6DVmKYFFGBAAaMyQILM0gNcTjmjmeqei3w== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCV6DVm1+yVMRAAru8qg4gOWpFzwTMt9P+MbA== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCZ6DVmcpvaDxAAPZ5wNkmtOH5qzE73Wj0UlA== 2024-05-04T07:49:53.014 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCc6DVm4i3AGRAAjZBrRi8M+IUtdJHhtT/axQ== 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+6DVmlFbsFBAAIn9GcuvztIqP7lCKmms1KA== 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+6DVmyp46HhAAJFW41LvazXR78tAHZM5w0A== 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+6DVm5n2TJxAAq7XBFt6ZvbDe+L2s+/0r/g== 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2024-05-04T07:49:53.015 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB+6DVmq/EjMRAA1KezP1A0XAjO9mOc546eRA== 2024-05-04T07:49:53.017 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T07:49:53.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T07:49:53.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:53.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:53.340 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:53.346 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:53.477 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:53.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T07:49:54.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T07:49:54.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:54.158 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:54.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:54.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T07:49:54.431 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.707 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.840 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T07:49:54.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:54.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.268 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T07:49:55.554 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-04T07:49:55.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-04T07:49:55.636 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T07:49:55.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-04T07:49:55.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-04T07:49:55.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T07:49:56.101 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-04T07:49:56.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-04T07:49:56.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T07:49:56.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-04T07:49:56.471 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:56.479 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T07:49:56.529 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-04T07:49:56.530 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-04T07:49:56.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-04T07:49:56.535 INFO:tasks.ceph.mon.a:Started 2024-05-04T07:49:56.535 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-04T07:49:56.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-04T07:49:56.573 INFO:tasks.ceph.mon.b:Started 2024-05-04T07:49:56.573 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-04T07:49:56.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-04T07:49:56.580 INFO:tasks.ceph.mon.c:Started 2024-05-04T07:49:56.580 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-04T07:49:56.580 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-04T07:49:56.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-04T07:49:56.586 INFO:tasks.ceph.mgr.y:Started 2024-05-04T07:49:56.587 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-04T07:49:56.587 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-04T07:49:56.591 INFO:tasks.ceph.mgr.x:Started 2024-05-04T07:49:56.591 INFO:tasks.ceph:Setting crush tunables to default 2024-05-04T07:49:56.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd crush tunables default 2024-05-04T07:49:56.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.761+0000 7f5f96800640 1 Processor -- start 2024-05-04T07:49:56.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.761+0000 7f5f96800640 1 -- start start 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.762+0000 7f5f96800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.762+0000 7f5f96800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.762+0000 7f5f96800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f900cd5e0 con 0x7f5f9006dc00 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.762+0000 7f5f96800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f5f900d2460 con 0x7f5f9015f2e0 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.762+0000 7f5f96800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5f900d1bc0 con 0x7f5f9015f6c0 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5f9006dc00 0x7f5f900cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:40254/0 (socket says 172.21.15.136:40254) 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8fe00640 1 -- 172.21.15.136:0/3509568845 learned_addr learned my addr 172.21.15.136:0/3509568845 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:56.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T07:49:56.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T07:49:56.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:56.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:56.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.763+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T07:49:56.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.964+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:56.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T07:49:56.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:56.965+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T07:49:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.366+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.366+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:57.367+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.168+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f87e00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:58.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:58.169+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9006d6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9006d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 msgr2=0x7f5f900d3910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.136:3300/0 conn(0x7f5f9015f2e0 0x7f5f900d3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 -- 172.21.15.136:0/3509568845 >> v1:172.21.15.136:6789/0 conn(0x7f5f9006dc00 legacy=0x7f5f900cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 -- 172.21.15.136:0/3509568845 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f900d1ea0 con 0x7f5f6c006170 2024-05-04T07:49:59.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.763+0000 7f5f8d600640 1 -- 172.21.15.136:0/3509568845 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5f900d2460 con 0x7f5f6c0036a0 2024-05-04T07:49:59.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.764+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:59.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.764+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:59.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.764+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:59.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.764+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:59.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.764+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T07:49:59.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.967+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:49:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.967+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:49:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.967+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:49:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.967+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:49:59.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:49:59.967+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T07:50:00.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:00.369+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:00.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:00.369+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:50:00.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:00.369+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:50:00.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:00.369+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:50:00.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:00.369+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T07:50:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:01.171+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:01.171+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-04T07:50:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:01.171+0000 7f5f8f400640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T07:50:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:01.171+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T07:50:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:01.171+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T07:50:02.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.003+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762500030 0 0) 0x7f5f900d1ea0 con 0x7f5f6c006170 2024-05-04T07:50:02.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.003+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f74003520 con 0x7f5f6c006170 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2860393437 0 0) 0x7f5f74003520 con 0x7f5f6c006170 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 msgr2=0x7f5f6c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 --2- 172.21.15.136:0/3509568845 >> v2:172.21.15.142:3300/0 conn(0x7f5f6c0036a0 0x7f5f6c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6c00aed0 con 0x7f5f6c006170 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f5f7800d580 con 0x7f5f6c006170 2024-05-04T07:50:02.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 >> v1:172.21.15.142:6789/0 conn(0x7f5f6c006170 legacy=0x7f5f6c008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8fe00640 1 -- 172.21.15.136:0/3509568845 reap_dead start 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f74003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900d2460 con 0x7f5f74004f40 2024-05-04T07:50:02.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.008+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7400bf00 con 0x7f5f74004100 2024-05-04T07:50:02.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.009+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7400c080 con 0x7f5f9015f6c0 2024-05-04T07:50:02.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.009+0000 7f5f8fe00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.009+0000 7f5f8f400640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f74003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.010+0000 7f5f87e00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.011+0000 7f5f8fe00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f74003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.011+0000 7f5f8fe00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f74003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.011+0000 7f5f8fe00640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 msgr2=0x7f5f74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.011+0000 7f5f8fe00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.011+0000 7f5f8fe00640 1 -- 172.21.15.136:0/3509568845 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f74003520 con 0x7f5f74004f40 2024-05-04T07:50:02.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.014+0000 7f5f8fe00640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f7400b9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f90072db0 tx=0x7f5f74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240f77c8d6c4e1be server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:02.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.018+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88001dc0 con 0x7f5f74004f40 2024-05-04T07:50:02.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.018+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f88032630 con 0x7f5f74004f40 2024-05-04T07:50:02.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.018+0000 7f5f8ea00640 1 -- 172.21.15.136:0/3509568845 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88032a20 con 0x7f5f74004f40 2024-05-04T07:50:02.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 -- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 msgr2=0x7f5f7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:02.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f7400b9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f90072db0 tx=0x7f5f74005830 comp rx=0 tx=0).stop 2024-05-04T07:50:02.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 -- 172.21.15.136:0/3509568845 shutdown_connections 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f74003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f7400b9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.019+0000 7f5f96800640 1 --2- 172.21.15.136:0/3509568845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f74004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.020+0000 7f5f96800640 1 -- 172.21.15.136:0/3509568845 >> 172.21.15.136:0/3509568845 conn(0x7f5f900d2df0 msgr2=0x7f5f900d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.020+0000 7f5f96800640 1 -- 172.21.15.136:0/3509568845 shutdown_connections 2024-05-04T07:50:02.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.020+0000 7f5f96800640 1 -- 172.21.15.136:0/3509568845 wait complete. 2024-05-04T07:50:02.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.024+0000 7f5f96800640 1 Processor -- start 2024-05-04T07:50:02.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.025+0000 7f5f96800640 1 -- start start 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f9015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900d3a90 con 0x7f5f74004f40 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900d3910 con 0x7f5f74004100 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f96800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5f900d3c10 con 0x7f5f9015f6c0 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f8f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f87e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f9015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f8f400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:38382/0 (socket says 172.21.15.136:38382) 2024-05-04T07:50:02.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f8f400640 1 -- 172.21.15.136:0/1246006705 learned_addr learned my addr 172.21.15.136:0/1246006705 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:02.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.026+0000 7f5f8fe00640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:02.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f87e00640 1 -- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 msgr2=0x7f5f9015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:02.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f87e00640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.028 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f87e00640 1 -- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 msgr2=0x7f5f9015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:02.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f87e00640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f87e00640 1 -- 172.21.15.136:0/1246006705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f900a0400 con 0x7f5f74004f40 2024-05-04T07:50:02.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.027+0000 7f5f8f400640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:02.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.028+0000 7f5f87e00640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f9015cd60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f900d3e50 tx=0x7f5f78016e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:02.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.031+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78014a50 con 0x7f5f74004f40 2024-05-04T07:50:02.032 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.031+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f78014bf0 con 0x7f5f74004f40 2024-05-04T07:50:02.032 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.031+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78017440 con 0x7f5f74004f40 2024-05-04T07:50:02.032 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.031+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f900a06e0 con 0x7f5f74004f40 2024-05-04T07:50:02.032 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.031+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f900b62d0 con 0x7f5f74004f40 2024-05-04T07:50:02.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.032+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5f78017970 con 0x7f5f74004f40 2024-05-04T07:50:02.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.032+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5f78020770 con 0x7f5f74004f40 2024-05-04T07:50:02.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.033+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f90069470 con 0x7f5f74004f40 2024-05-04T07:50:02.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.037+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5f7802f080 con 0x7f5f74004f40 2024-05-04T07:50:02.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.128+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5f900d1b20 con 0x7f5f74004f40 2024-05-04T07:50:02.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.131+0000 7f5f87400640 1 -- 172.21.15.136:0/1246006705 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5f78029d50 con 0x7f5f74004f40 2024-05-04T07:50:02.131 INFO:teuthology.orchestra.run.smithi136.stderr:adjusted tunables profile to default 2024-05-04T07:50:02.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 msgr2=0x7f5f9015cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:02.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f9015cd60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5f900d3e50 tx=0x7f5f78016e80 comp rx=0 tx=0).stop 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 shutdown_connections 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9015f6c0 0x7f5f9015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f74004f40 0x7f5f9015cd60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 --2- 172.21.15.136:0/1246006705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f74004100 0x7f5f9015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 >> 172.21.15.136:0/1246006705 conn(0x7f5f900d2df0 msgr2=0x7f5f90070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 shutdown_connections 2024-05-04T07:50:02.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:02.133+0000 7f5f96800640 1 -- 172.21.15.136:0/1246006705 wait complete. 2024-05-04T07:50:02.159 INFO:tasks.ceph:check_enable_crimson: False 2024-05-04T07:50:02.159 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-04T07:50:02.159 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:02.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-04T07:50:02.180 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:02.179+0000 7f70cf212040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T07:50:02.190 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:02.189+0000 7f8c8c3d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T07:50:02.224 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:02.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-04T07:50:02.348 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:02.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-04T07:50:02.390 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:02.389+0000 7f70cf212040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T07:50:02.406 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:02.405+0000 7f8c8c3d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T07:50:02.456 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:02.456+0000 7f70cf212040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T07:50:02.459 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:02.459 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-04T07:50:02.470 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:02.470+0000 7f8c8c3d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T07:50:02.540 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:50:02.540 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-04T07:50:02.627 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:50:02.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-04T07:50:02.699 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:50:02.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-04T07:50:02.758 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:02.755+0000 7f8c8c3d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T07:50:02.788 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:02.788+0000 7f70cf212040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T07:50:02.809 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:02.808+0000 7f8c8c3d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T07:50:02.812 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:50:02.813 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-04T07:50:02.855 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:02.855+0000 7f70cf212040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T07:50:02.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 1995056f-f975-4719-a17e-b363ac8c48ca 0 2024-05-04T07:50:03.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.114+0000 7f8703200640 1 Processor -- start 2024-05-04T07:50:03.115 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.114+0000 7f8703200640 1 -- start start 2024-05-04T07:50:03.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8703200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87040cfa70 0x7f87040cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8703200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040d0a10 con 0x7f87040d0420 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8703200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87040d0cf0 con 0x7f870415f0e0 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8703200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f87040b8850 con 0x7f87040cfa70 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8701e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f870415f0e0 0x7f87040d58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43180/0 (socket says 172.21.15.142:43180) 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8701e00640 1 -- 172.21.15.142:0/2567079041 learned_addr learned my addr 172.21.15.142:0/2567079041 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-05-04T07:50:03.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.116+0000 7f8701400640 1 --2- 172.21.15.142:0/2567079041 >> v2:172.21.15.142:3300/0 conn(0x7f87040cfa70 0x7f87040cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.117+0000 7f8701400640 1 -- 172.21.15.142:0/2567079041 >> v1:172.21.15.142:6789/0 conn(0x7f870415f0e0 legacy=0x7f87040d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.117+0000 7f8701400640 1 -- 172.21.15.142:0/2567079041 >> v1:172.21.15.136:6789/0 conn(0x7f87040d0420 legacy=0x7f87040b92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.117+0000 7f8701400640 1 -- 172.21.15.142:0/2567079041 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87040b8aa0 con 0x7f87040cfa70 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8701400640 1 --2- 172.21.15.142:0/2567079041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f87040cfee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f86f00097a0 tx=0x7f86f002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b92a420e260a210 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8700a00640 1 -- 172.21.15.142:0/2567079041 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0037070 con 0x7f87040cfa70 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8700a00640 1 -- 172.21.15.142:0/2567079041 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f0032440 con 0x7f87040cfa70 2024-05-04T07:50:03.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8700a00640 1 -- 172.21.15.142:0/2567079041 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f0032810 con 0x7f87040cfa70 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8703200640 1 -- 172.21.15.142:0/2567079041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 msgr2=0x7f87040cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8703200640 1 --2- 172.21.15.142:0/2567079041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f87040cfee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f86f00097a0 tx=0x7f86f002a210 comp rx=0 tx=0).stop 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8703200640 1 -- 172.21.15.142:0/2567079041 shutdown_connections 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8703200640 1 --2- 172.21.15.142:0/2567079041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f87040cfee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.118+0000 7f8703200640 1 -- 172.21.15.142:0/2567079041 >> 172.21.15.142:0/2567079041 conn(0x7f870409e380 msgr2=0x7f87040d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.119+0000 7f8703200640 1 -- 172.21.15.142:0/2567079041 shutdown_connections 2024-05-04T07:50:03.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.119+0000 7f8703200640 1 -- 172.21.15.142:0/2567079041 wait complete. 2024-05-04T07:50:03.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.120+0000 7f8703200640 1 Processor -- start 2024-05-04T07:50:03.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.120+0000 7f8703200640 1 -- start start 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87040d0420 0x7f87041f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f870415f0e0 0x7f87040cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87040d3d40 con 0x7f87040d0420 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f870415f4c0 con 0x7f87040cfa70 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.121+0000 7f8703200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f87040b99b0 con 0x7f870415f0e0 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8702800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f870415f0e0 0x7f87040cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50362/0 (socket says 172.21.15.142:50362) 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 -- 172.21.15.142:0/636615952 learned_addr learned my addr 172.21.15.142:0/636615952 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701400640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87040d0420 0x7f87041f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 -- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f870415f0e0 msgr2=0x7f87040cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.123 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f870415f0e0 0x7f87040cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 -- 172.21.15.142:0/636615952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87040d0420 msgr2=0x7f87041f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87040d0420 0x7f87041f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 -- 172.21.15.142:0/636615952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87041f4fb0 con 0x7f87040cfa70 2024-05-04T07:50:03.124 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f8701e00640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f86f4001eb0 tx=0x7f86f400c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.122+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4017070 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.123+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f4005d00 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.123+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4007310 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.123+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870415d0b0 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.123+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f870415a580 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.124+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86f401a070 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.124+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f86f4012740 con 0x7f87040cfa70 2024-05-04T07:50:03.125 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.124+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8704069400 con 0x7f87040cfa70 2024-05-04T07:50:03.127 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.127+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f86f4021020 con 0x7f87040cfa70 2024-05-04T07:50:03.206 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.205+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1995056f-f975-4719-a17e-b363ac8c48ca", "id": 0} v 0) -- 0x7f870415f640 con 0x7f87040cfa70 2024-05-04T07:50:03.212 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.212+0000 7f86fa000640 1 -- 172.21.15.142:0/636615952 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1995056f-f975-4719-a17e-b363ac8c48ca", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f86f4007640 con 0x7f87040cfa70 2024-05-04T07:50:03.213 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.213+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 msgr2=0x7f870415cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.213+0000 7f8703200640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f86f4001eb0 tx=0x7f86f400c890 comp rx=0 tx=0).stop 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.213+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 shutdown_connections 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f870415f0e0 0x7f87040cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87040d0420 0x7f87041f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 --2- 172.21.15.142:0/636615952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87040cfa70 0x7f870415cad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 >> 172.21.15.142:0/636615952 conn(0x7f870409e380 msgr2=0x7f87040d58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 shutdown_connections 2024-05-04T07:50:03.215 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.214+0000 7f8703200640 1 -- 172.21.15.142:0/636615952 wait complete. 2024-05-04T07:50:03.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 5de40d6d-0279-441d-a67a-18bd62fae91c 1 2024-05-04T07:50:03.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.408+0000 7f7651200640 1 Processor -- start 2024-05-04T07:50:03.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.408+0000 7f7651200640 1 -- start start 2024-05-04T07:50:03.410 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f764c0d1a50 0x7f764c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f764c0b6140 0x7f764c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1e30 0x7f764c0d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f764c0d07d0 con 0x7f764c0b6140 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f764c0d0ab0 con 0x7f764c0d1a50 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7651200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f764c0d0d90 con 0x7f764c0d1e30 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f7649e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f764c0d1a50 0x7f764c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.409+0000 7f764a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1e30 0x7f764c0d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f764c0d1a50 0x7f764c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50368/0 (socket says 172.21.15.142:50368) 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 -- 172.21.15.142:0/981824839 learned_addr learned my addr 172.21.15.142:0/981824839 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649400640 1 --2- 172.21.15.142:0/981824839 >> v2:172.21.15.136:3300/0 conn(0x7f764c0b6140 0x7f764c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 -- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1e30 msgr2=0x7f764c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.411 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 --2- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1e30 0x7f764c0d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 -- 172.21.15.142:0/981824839 >> v2:172.21.15.136:3300/0 conn(0x7f764c0b6140 msgr2=0x7f764c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 --2- 172.21.15.142:0/981824839 >> v2:172.21.15.136:3300/0 conn(0x7f764c0b6140 0x7f764c15f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.412 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.410+0000 7f7649e00640 1 -- 172.21.15.142:0/981824839 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c0d5eb0 con 0x7f764c0d1a50 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.411+0000 7f7649e00640 1 --2- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0d1a50 0x7f764c15f190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f764c0b7c50 tx=0x7f763c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d46b9767f5976671 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.411+0000 7f7648a00640 1 -- 172.21.15.142:0/981824839 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c037070 con 0x7f764c0d1a50 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.411+0000 7f7648a00640 1 -- 172.21.15.142:0/981824839 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c032440 con 0x7f764c0d1a50 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.411+0000 7f7648a00640 1 -- 172.21.15.142:0/981824839 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c032810 con 0x7f764c0d1a50 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 -- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0d1a50 msgr2=0x7f764c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 --2- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0d1a50 0x7f764c15f190 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f764c0b7c50 tx=0x7f763c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 -- 172.21.15.142:0/981824839 shutdown_connections 2024-05-04T07:50:03.413 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 --2- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1e30 0x7f764c0d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 --2- 172.21.15.142:0/981824839 >> v2:172.21.15.136:3300/0 conn(0x7f764c0b6140 0x7f764c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 --2- 172.21.15.142:0/981824839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0d1a50 0x7f764c15f190 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 -- 172.21.15.142:0/981824839 >> 172.21.15.142:0/981824839 conn(0x7f764c0d5080 msgr2=0x7f764c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 -- 172.21.15.142:0/981824839 shutdown_connections 2024-05-04T07:50:03.414 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.412+0000 7f7651200640 1 -- 172.21.15.142:0/981824839 wait complete. 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.414+0000 7f7651200640 1 Processor -- start 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.414+0000 7f7651200640 1 -- start start 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1a50 0x7f764c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f764c0d1e30 0x7f764c0b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f764c0b6810 con 0x7f764c0d1e30 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f764c0b6690 con 0x7f764c0b6140 2024-05-04T07:50:03.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7651200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f764c0d33a0 con 0x7f764c0d1a50 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1a50 0x7f764c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50378/0 (socket says 172.21.15.142:50378) 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 -- 172.21.15.142:0/2214363482 learned_addr learned my addr 172.21.15.142:0/2214363482 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 -- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1a50 msgr2=0x7f764c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1a50 0x7f764c0ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 -- 172.21.15.142:0/2214363482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f764c0d1e30 msgr2=0x7f764c0b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f764c0d1e30 0x7f764c0b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.420 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 -- 172.21.15.142:0/2214363482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c156420 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.415+0000 7f7649e00640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f763c02a220 tx=0x7f763c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c037040 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c042070 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c03b870 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c156700 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c1f5170 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f763c03ba10 con 0x7f764c0b6140 2024-05-04T07:50:03.421 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.416+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f763c047bd0 con 0x7f764c0b6140 2024-05-04T07:50:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.417+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c069470 con 0x7f764c0b6140 2024-05-04T07:50:03.422 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.419+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f763c047e20 con 0x7f764c0b6140 2024-05-04T07:50:03.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.498+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5de40d6d-0279-441d-a67a-18bd62fae91c", "id": 1} v 0) -- 0x7f764c1f5400 con 0x7f764c0b6140 2024-05-04T07:50:03.504 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.503+0000 7f7642000640 1 -- 172.21.15.142:0/2214363482 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5de40d6d-0279-441d-a67a-18bd62fae91c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f763c047460 con 0x7f764c0b6140 2024-05-04T07:50:03.504 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 msgr2=0x7f764c154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f763c02a220 tx=0x7f763c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 shutdown_connections 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f764c0d1e30 0x7f764c0b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f764c0d1a50 0x7f764c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 --2- 172.21.15.142:0/2214363482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f764c0b6140 0x7f764c154680 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.504+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 >> 172.21.15.142:0/2214363482 conn(0x7f764c0d5080 msgr2=0x7f764c0d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.505+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 shutdown_connections 2024-05-04T07:50:03.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.505+0000 7f7651200640 1 -- 172.21.15.142:0/2214363482 wait complete. 2024-05-04T07:50:03.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 108de325-41aa-4eb3-844d-df06c2eabe3f 2 2024-05-04T07:50:03.692 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.692+0000 7fa04a000640 1 Processor -- start 2024-05-04T07:50:03.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.692+0000 7fa04a000640 1 -- start start 2024-05-04T07:50:03.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.693+0000 7fa04a000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa0440cfa70 0x7fa0440cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.693+0000 7fa04a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.693+0000 7fa04a000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0440d0a10 con 0x7fa04415f0e0 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.693+0000 7fa04a000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa0440b8850 con 0x7fa0440cfa70 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.693+0000 7fa04a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa0440d0cf0 con 0x7fa0440d0420 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51910/0 (socket says 172.21.15.142:51910) 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 -- 172.21.15.142:0/1667837234 learned_addr learned my addr 172.21.15.142:0/1667837234 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa043e00640 1 --2- 172.21.15.142:0/1667837234 >> v2:172.21.15.136:3300/0 conn(0x7fa0440cfa70 0x7fa0440cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 -- 172.21.15.142:0/1667837234 >> v2:172.21.15.136:3300/0 conn(0x7fa0440cfa70 msgr2=0x7fa0440cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 --2- 172.21.15.142:0/1667837234 >> v2:172.21.15.136:3300/0 conn(0x7fa0440cfa70 0x7fa0440cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 -- 172.21.15.142:0/1667837234 >> v1:172.21.15.136:6789/0 conn(0x7fa04415f0e0 legacy=0x7fa0440d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.694+0000 7fa049600640 1 -- 172.21.15.142:0/1667837234 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0440b8aa0 con 0x7fa0440d0420 2024-05-04T07:50:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.696+0000 7fa049600640 1 --2- 172.21.15.142:0/1667837234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e50 tx=0x7fa03c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5e473cddb631ed server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.696+0000 7fa043400640 1 -- 172.21.15.142:0/1667837234 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c036070 con 0x7fa0440d0420 2024-05-04T07:50:03.696 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.696+0000 7fa043400640 1 -- 172.21.15.142:0/1667837234 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c031600 con 0x7fa0440d0420 2024-05-04T07:50:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.696+0000 7fa043400640 1 -- 172.21.15.142:0/1667837234 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0319d0 con 0x7fa0440d0420 2024-05-04T07:50:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 -- 172.21.15.142:0/1667837234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 msgr2=0x7fa0440b92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.697 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 --2- 172.21.15.142:0/1667837234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e50 tx=0x7fa03c02a710 comp rx=0 tx=0).stop 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 -- 172.21.15.142:0/1667837234 shutdown_connections 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 --2- 172.21.15.142:0/1667837234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440d0420 0x7fa0440b92a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 --2- 172.21.15.142:0/1667837234 >> v2:172.21.15.136:3300/0 conn(0x7fa0440cfa70 0x7fa0440cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 -- 172.21.15.142:0/1667837234 >> 172.21.15.142:0/1667837234 conn(0x7fa04409e380 msgr2=0x7fa0440d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 -- 172.21.15.142:0/1667837234 shutdown_connections 2024-05-04T07:50:03.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.697+0000 7fa04a000640 1 -- 172.21.15.142:0/1667837234 wait complete. 2024-05-04T07:50:03.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.699+0000 7fa04a000640 1 Processor -- start 2024-05-04T07:50:03.699 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.699+0000 7fa04a000640 1 -- start start 2024-05-04T07:50:03.700 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0440d0420 0x7fa0440a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 0x7fa0440a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa0440d3d40 con 0x7fa0440d0420 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa04415f4c0 con 0x7fa04415f0e0 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa04a000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa0440b97e0 con 0x7fa0440cfa70 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa048c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa049600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 0x7fa0440a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa048c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51912/0 (socket says 172.21.15.142:51912) 2024-05-04T07:50:03.701 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa048c00640 1 -- 172.21.15.142:0/2644332337 learned_addr learned my addr 172.21.15.142:0/2644332337 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.700+0000 7fa043e00640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0440d0420 0x7fa0440a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 -- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 msgr2=0x7fa0440a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 0x7fa0440a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 -- 172.21.15.142:0/2644332337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0440d0420 msgr2=0x7fa0440a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0440d0420 0x7fa0440a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 -- 172.21.15.142:0/2644332337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04415b320 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa049600640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 0x7fa0440a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa048c00640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b3f0 tx=0x7fa03800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038015020 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa038011830 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04415b600 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.701+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa038011c20 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.702+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04415bbc0 con 0x7fa0440cfa70 2024-05-04T07:50:03.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.702+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa038018020 con 0x7fa0440cfa70 2024-05-04T07:50:03.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.702+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa0380043b0 con 0x7fa0440cfa70 2024-05-04T07:50:03.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.703+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044069400 con 0x7fa0440cfa70 2024-05-04T07:50:03.709 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.709+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa03801f030 con 0x7fa0440cfa70 2024-05-04T07:50:03.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.785+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "108de325-41aa-4eb3-844d-df06c2eabe3f", "id": 2} v 0) -- 0x7fa044073f30 con 0x7fa0440cfa70 2024-05-04T07:50:03.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.792+0000 7fa040c00640 1 -- 172.21.15.142:0/2644332337 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "108de325-41aa-4eb3-844d-df06c2eabe3f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa0380035f0 con 0x7fa0440cfa70 2024-05-04T07:50:03.793 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-05-04T07:50:03.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 msgr2=0x7fa0441504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa03800b3f0 tx=0x7fa03800b8b0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 shutdown_connections 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa04415f0e0 0x7fa0440a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0440d0420 0x7fa0440a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 --2- 172.21.15.142:0/2644332337 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0440cfa70 0x7fa0441504d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 >> 172.21.15.142:0/2644332337 conn(0x7fa04409e380 msgr2=0x7fa04406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 shutdown_connections 2024-05-04T07:50:03.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.794+0000 7fa04a000640 1 -- 172.21.15.142:0/2644332337 wait complete. 2024-05-04T07:50:03.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new e2f45b44-f8c2-45cc-92b6-92a394de8264 3 2024-05-04T07:50:03.818 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:03.818+0000 7f8c8c3d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T07:50:03.819 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:03.818+0000 7f70cf212040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T07:50:03.921 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:03.920+0000 7f8c8c3d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T07:50:03.932 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:03.931+0000 7f70cf212040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T07:50:03.975 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:03.971+0000 7f8c8c3d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T07:50:03.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.977+0000 7fae16e00640 1 Processor -- start 2024-05-04T07:50:03.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.977+0000 7fae16e00640 1 -- start start 2024-05-04T07:50:03.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae16e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae16e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fae100c9cc0 0x7fae1015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae16e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae100d07d0 con 0x7fae100b6140 2024-05-04T07:50:03.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae16e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fae100d0ab0 con 0x7fae100c9cc0 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae16e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fae100d0d90 con 0x7fae100d1a50 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae0fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae07400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fae100b6140 0x7fae100d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43186/0 (socket says 172.21.15.142:43186) 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae0fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51926/0 (socket says 172.21.15.142:51926) 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae07400640 1 -- 172.21.15.142:0/482028830 learned_addr learned my addr 172.21.15.142:0/482028830 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.979+0000 7fae14e00640 1 --2- 172.21.15.142:0/482028830 >> v2:172.21.15.136:3300/0 conn(0x7fae100c9cc0 0x7fae1015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.980+0000 7fae0fe00640 1 -- 172.21.15.142:0/482028830 >> v2:172.21.15.136:3300/0 conn(0x7fae100c9cc0 msgr2=0x7fae1015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.980+0000 7fae0fe00640 1 --2- 172.21.15.142:0/482028830 >> v2:172.21.15.136:3300/0 conn(0x7fae100c9cc0 0x7fae1015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.980+0000 7fae0fe00640 1 -- 172.21.15.142:0/482028830 >> v1:172.21.15.142:6789/0 conn(0x7fae100b6140 legacy=0x7fae100d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.980+0000 7fae0fe00640 1 -- 172.21.15.142:0/482028830 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae100d5eb0 con 0x7fae100d1a50 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.981+0000 7fae0fe00640 1 --2- 172.21.15.142:0/482028830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae0002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42f7802c024add3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.981+0000 7fae0f400640 1 -- 172.21.15.142:0/482028830 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00037070 con 0x7fae100d1a50 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.981+0000 7fae0f400640 1 -- 172.21.15.142:0/482028830 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00032440 con 0x7fae100d1a50 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.981+0000 7fae0f400640 1 -- 172.21.15.142:0/482028830 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00032810 con 0x7fae100d1a50 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 -- 172.21.15.142:0/482028830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 msgr2=0x7fae1015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 --2- 172.21.15.142:0/482028830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae0002a180 comp rx=0 tx=0).stop 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 -- 172.21.15.142:0/482028830 shutdown_connections 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 --2- 172.21.15.142:0/482028830 >> v2:172.21.15.136:3300/0 conn(0x7fae100c9cc0 0x7fae1015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 --2- 172.21.15.142:0/482028830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100d1a50 0x7fae1015f190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 -- 172.21.15.142:0/482028830 >> 172.21.15.142:0/482028830 conn(0x7fae100d5080 msgr2=0x7fae100d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:03.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 -- 172.21.15.142:0/482028830 shutdown_connections 2024-05-04T07:50:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.982+0000 7fae16e00640 1 -- 172.21.15.142:0/482028830 wait complete. 2024-05-04T07:50:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.984+0000 7fae16e00640 1 Processor -- start 2024-05-04T07:50:03.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.984+0000 7fae16e00640 1 -- start start 2024-05-04T07:50:03.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae100b6140 0x7fae10156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae100d1a50 0x7fae100ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fae100b6810 con 0x7fae100b6140 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fae100b6690 con 0x7fae100d1a50 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae16e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fae100d1e30 con 0x7fae100c9cc0 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51930/0 (socket says 172.21.15.142:51930) 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 -- 172.21.15.142:0/3958653494 learned_addr learned my addr 172.21.15.142:0/3958653494 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae14e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae100d1a50 0x7fae100ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae0fe00640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae100b6140 0x7fae10156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 -- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae100d1a50 msgr2=0x7fae100ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae100d1a50 0x7fae100ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 -- 172.21.15.142:0/3958653494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae100b6140 msgr2=0x7fae10156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:03.988 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae100b6140 0x7fae10156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.985+0000 7fae07400640 1 -- 172.21.15.142:0/3958653494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae10156840 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae07400640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c4d0 tx=0x7fadf800c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8017070 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf8005d00 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae100b91f0 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80072b0 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae100b97b0 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fadf801a070 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.986+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fadf801c440 con 0x7fae100c9cc0 2024-05-04T07:50:03.989 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.987+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae10069470 con 0x7fae100c9cc0 2024-05-04T07:50:03.990 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:03.990+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fadf8021070 con 0x7fae100c9cc0 2024-05-04T07:50:03.991 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:03.990+0000 7f70cf212040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T07:50:04.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.070+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2f45b44-f8c2-45cc-92b6-92a394de8264", "id": 3} v 0) -- 0x7fae100cb130 con 0x7fae100c9cc0 2024-05-04T07:50:04.078 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.078+0000 7fae0cc00640 1 -- 172.21.15.142:0/3958653494 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2f45b44-f8c2-45cc-92b6-92a394de8264", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fadf801c760 con 0x7fae100c9cc0 2024-05-04T07:50:04.079 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 msgr2=0x7fae100ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c4d0 tx=0x7fadf800c990 comp rx=0 tx=0).stop 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 shutdown_connections 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae100d1a50 0x7fae100ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae100c9cc0 0x7fae100ce320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 --2- 172.21.15.142:0/3958653494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae100b6140 0x7fae10156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 >> 172.21.15.142:0/3958653494 conn(0x7fae100d5080 msgr2=0x7fae1006d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.080 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 shutdown_connections 2024-05-04T07:50:04.081 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.079+0000 7fae16e00640 1 -- 172.21.15.142:0/3958653494 wait complete. 2024-05-04T07:50:04.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b4e9985e-b481-49b4-af5a-13a16824273a 4 2024-05-04T07:50:04.165 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:04.165+0000 7f8c8c3d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T07:50:04.202 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:04.202+0000 7f70cf212040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T07:50:04.227 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:04.226+0000 7f8c8c3d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T07:50:04.275 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:04.274+0000 7f70cf212040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T07:50:04.289 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:04.288+0000 7f8c8c3d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T07:50:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.327+0000 7f101f200640 1 Processor -- start 2024-05-04T07:50:04.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.328+0000 7f101f200640 1 -- start start 2024-05-04T07:50:04.329 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f10200d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101f200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10200d5e00 con 0x7f10200cfa70 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10200d0a10 con 0x7f10200b92a0 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f10200b8850 con 0x7f102015f0e0 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f10200d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101e800640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f10200b92a0 0x7f10200b9710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43190/0 (socket says 172.21.15.142:43190) 2024-05-04T07:50:04.330 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.329+0000 7f101e800640 1 -- 172.21.15.142:0/4073379518 learned_addr learned my addr 172.21.15.142:0/4073379518 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-05-04T07:50:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.330+0000 7f101ca00640 1 -- 172.21.15.142:0/4073379518 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567332252 0 0) 0x7f10200d0a10 con 0x7f10200b92a0 2024-05-04T07:50:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.330+0000 7f101de00640 1 -- 172.21.15.142:0/4073379518 >> v1:172.21.15.142:6789/0 conn(0x7f10200b92a0 legacy=0x7f10200b9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.330+0000 7f101de00640 1 -- 172.21.15.142:0/4073379518 >> v1:172.21.15.136:6789/0 conn(0x7f10200cfa70 legacy=0x7f10200cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:04.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.330+0000 7f101de00640 1 -- 172.21.15.142:0/4073379518 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200d0cf0 con 0x7f102015f0e0 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.331+0000 7f101de00640 1 --2- 172.21.15.142:0/4073379518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f10200d58c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10100097d0 tx=0x7f101002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8033bd1a08bb4690 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.331+0000 7f101ca00640 1 -- 172.21.15.142:0/4073379518 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010037070 con 0x7f102015f0e0 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.331+0000 7f101ca00640 1 -- 172.21.15.142:0/4073379518 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010032440 con 0x7f102015f0e0 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.331+0000 7f101ca00640 1 -- 172.21.15.142:0/4073379518 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010032810 con 0x7f102015f0e0 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 -- 172.21.15.142:0/4073379518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 msgr2=0x7f10200d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.332 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 --2- 172.21.15.142:0/4073379518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f10200d58c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f10100097d0 tx=0x7f101002a200 comp rx=0 tx=0).stop 2024-05-04T07:50:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 -- 172.21.15.142:0/4073379518 shutdown_connections 2024-05-04T07:50:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 --2- 172.21.15.142:0/4073379518 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f10200d58c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 -- 172.21.15.142:0/4073379518 >> 172.21.15.142:0/4073379518 conn(0x7f102009e380 msgr2=0x7f10200d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 -- 172.21.15.142:0/4073379518 shutdown_connections 2024-05-04T07:50:04.333 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.332+0000 7f101f200640 1 -- 172.21.15.142:0/4073379518 wait complete. 2024-05-04T07:50:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.333+0000 7f101f200640 1 Processor -- start 2024-05-04T07:50:04.334 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 -- start start 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 0x7f102014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10200cfa70 0x7f10201520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f102015f4c0 con 0x7f10200b92a0 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10200b8d80 con 0x7f10200cfa70 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.334+0000 7f101f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f10200d3d40 con 0x7f102015f0e0 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101d400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10200cfa70 0x7f10201520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51946/0 (socket says 172.21.15.142:51946) 2024-05-04T07:50:04.337 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 -- 172.21.15.142:0/1834430316 learned_addr learned my addr 172.21.15.142:0/1834430316 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101de00640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 0x7f102014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 -- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10200cfa70 msgr2=0x7f10201520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10200cfa70 0x7f10201520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 -- 172.21.15.142:0/1834430316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 msgr2=0x7f102014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 0x7f102014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101e800640 1 -- 172.21.15.142:0/1834430316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10200a11e0 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.335+0000 7f101de00640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 0x7f102014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f101e800640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f101800c7a0 tx=0x7f101800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018018070 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f101800a5e0 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101800aa50 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10200a14c0 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10200a1a80 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f101800abf0 con 0x7f102015f0e0 2024-05-04T07:50:04.338 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.336+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f10180129b0 con 0x7f102015f0e0 2024-05-04T07:50:04.339 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.337+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1020069400 con 0x7f102015f0e0 2024-05-04T07:50:04.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.340+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1018021070 con 0x7f102015f0e0 2024-05-04T07:50:04.341 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:04.340+0000 7f70cf212040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T07:50:04.417 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:04.417+0000 7f8c8c3d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T07:50:04.419 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.418+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4e9985e-b481-49b4-af5a-13a16824273a", "id": 4} v 0) -- 0x7f10200cf100 con 0x7f102015f0e0 2024-05-04T07:50:04.429 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.429+0000 7f1016000640 1 -- 172.21.15.142:0/1834430316 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4e9985e-b481-49b4-af5a-13a16824273a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f10180124a0 con 0x7f102015f0e0 2024-05-04T07:50:04.430 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 msgr2=0x7f1020160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f101800c7a0 tx=0x7f101800cc60 comp rx=0 tx=0).stop 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 shutdown_connections 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f102015f0e0 0x7f1020160ed0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10200cfa70 0x7f10201520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 --2- 172.21.15.142:0/1834430316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10200b92a0 0x7f102014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 >> 172.21.15.142:0/1834430316 conn(0x7f102009e380 msgr2=0x7f10200d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 shutdown_connections 2024-05-04T07:50:04.431 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.430+0000 7f101f200640 1 -- 172.21.15.142:0/1834430316 wait complete. 2024-05-04T07:50:04.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b807b4ca-2c3c-467a-aced-d47ebe2c0854 5 2024-05-04T07:50:04.477 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:04.477+0000 7f70cf212040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T07:50:04.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.624+0000 7f1febe00640 1 Processor -- start 2024-05-04T07:50:04.625 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.624+0000 7f1febe00640 1 -- start start 2024-05-04T07:50:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.625+0000 7f1febe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.625+0000 7f1febe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec0d0a10 con 0x7f1fec15f0e0 2024-05-04T07:50:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.625+0000 7f1febe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec0d0cf0 con 0x7f1fec0d03f0 2024-05-04T07:50:04.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.625+0000 7f1febe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b8850 con 0x7f1fec0cfa70 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1fea000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1feb400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1fec0d03f0 0x7f1fec0b92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43198/0 (socket says 172.21.15.142:43198) 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1feb400640 1 -- 172.21.15.142:0/2016273568 learned_addr learned my addr 172.21.15.142:0/2016273568 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1fea000640 1 -- 172.21.15.142:0/2016273568 >> v1:172.21.15.142:6789/0 conn(0x7f1fec0d03f0 legacy=0x7f1fec0b92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1fe9600640 1 -- 172.21.15.142:0/2016273568 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128098307 0 0) 0x7f1fec0d0cf0 con 0x7f1fec0d03f0 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1fea000640 1 -- 172.21.15.142:0/2016273568 >> v1:172.21.15.136:6789/0 conn(0x7f1fec15f0e0 legacy=0x7f1fec0d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.626+0000 7f1fea000640 1 -- 172.21.15.142:0/2016273568 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0b8aa0 con 0x7f1fec0cfa70 2024-05-04T07:50:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.627+0000 7f1fea000640 1 --2- 172.21.15.142:0/2016273568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec0cfeb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097d0 tx=0x7f1fd802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f03258dd32148fb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.627+0000 7f1fe9600640 1 -- 172.21.15.142:0/2016273568 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8037070 con 0x7f1fec0cfa70 2024-05-04T07:50:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1fe9600640 1 -- 172.21.15.142:0/2016273568 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd8032440 con 0x7f1fec0cfa70 2024-05-04T07:50:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1fe9600640 1 -- 172.21.15.142:0/2016273568 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8032810 con 0x7f1fec0cfa70 2024-05-04T07:50:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 -- 172.21.15.142:0/2016273568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 msgr2=0x7f1fec0cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 --2- 172.21.15.142:0/2016273568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec0cfeb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097d0 tx=0x7f1fd802a200 comp rx=0 tx=0).stop 2024-05-04T07:50:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 -- 172.21.15.142:0/2016273568 shutdown_connections 2024-05-04T07:50:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 --2- 172.21.15.142:0/2016273568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec0cfeb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 -- 172.21.15.142:0/2016273568 >> 172.21.15.142:0/2016273568 conn(0x7f1fec09e380 msgr2=0x7f1fec0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 -- 172.21.15.142:0/2016273568 shutdown_connections 2024-05-04T07:50:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.628+0000 7f1febe00640 1 -- 172.21.15.142:0/2016273568 wait complete. 2024-05-04T07:50:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.630+0000 7f1febe00640 1 Processor -- start 2024-05-04T07:50:04.631 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.630+0000 7f1febe00640 1 -- start start 2024-05-04T07:50:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fec15f0e0 0x7f1fec0a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0d3d40 con 0x7f1fec15f0e0 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec15f4c0 con 0x7f1fec0d03f0 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1febe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b99b0 con 0x7f1fec0cfa70 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1feaa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1fea000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1fea000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50424/0 (socket says 172.21.15.142:50424) 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.631+0000 7f1fea000640 1 -- 172.21.15.142:0/3158430029 learned_addr learned my addr 172.21.15.142:0/3158430029 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:04.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1feb400640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fec15f0e0 0x7f1fec0a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 -- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 msgr2=0x7f1fec153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 -- 172.21.15.142:0/3158430029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fec15f0e0 msgr2=0x7f1fec0a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fec15f0e0 0x7f1fec0a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 -- 172.21.15.142:0/3158430029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0a0510 con 0x7f1fec0d03f0 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fea000640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009720 tx=0x7f1fd80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8041070 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd803c870 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8037040 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0a07f0 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.632+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec0a0db0 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.633+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1fd8044070 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.633+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f1fd8046a90 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.634+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec069400 con 0x7f1fec0d03f0 2024-05-04T07:50:04.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.636+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1fd803cc60 con 0x7f1fec0d03f0 2024-05-04T07:50:04.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.714+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b807b4ca-2c3c-467a-aced-d47ebe2c0854", "id": 5} v 0) -- 0x7f1fec162970 con 0x7f1fec0d03f0 2024-05-04T07:50:04.725 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.725+0000 7f1fe3400640 1 -- 172.21.15.142:0/3158430029 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b807b4ca-2c3c-467a-aced-d47ebe2c0854", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1fd8046450 con 0x7f1fec0d03f0 2024-05-04T07:50:04.726 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 msgr2=0x7f1fec0a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009720 tx=0x7f1fd80046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 shutdown_connections 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fec15f0e0 0x7f1fec0a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fec0d03f0 0x7f1fec0a1750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.727 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 --2- 172.21.15.142:0/3158430029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fec0cfa70 0x7f1fec153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.726+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 >> 172.21.15.142:0/3158430029 conn(0x7f1fec09e380 msgr2=0x7f1fec0d58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.727+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 shutdown_connections 2024-05-04T07:50:04.728 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.727+0000 7f1febe00640 1 -- 172.21.15.142:0/3158430029 wait complete. 2024-05-04T07:50:04.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new f8ffaa6b-f025-450e-b0a9-af514bec2462 6 2024-05-04T07:50:04.876 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:04.875+0000 7f8c8c3d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-04T07:50:04.958 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:04.957+0000 7f70cf212040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-04T07:50:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.970+0000 7f178b200640 1 Processor -- start 2024-05-04T07:50:04.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.970+0000 7f178b200640 1 -- start start 2024-05-04T07:50:04.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.971+0000 7f178b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.971+0000 7f178b200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f178c0d3c30 0x7f178c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.971+0000 7f178b200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f178c0b7ec0 con 0x7f178c15f1c0 2024-05-04T07:50:04.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.971+0000 7f178b200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f178c0d2340 con 0x7f178c0d3c30 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.971+0000 7f178b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f178c0b81a0 con 0x7f178c15f5a0 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f178a800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f178c0d3c30 0x7f178c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51980/0 (socket says 172.21.15.142:51980) 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 -- 172.21.15.142:0/3685286578 learned_addr learned my addr 172.21.15.142:0/3685286578 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:04.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 -- 172.21.15.142:0/3685286578 >> v2:172.21.15.136:3300/0 conn(0x7f178c0d3c30 msgr2=0x7f178c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 --2- 172.21.15.142:0/3685286578 >> v2:172.21.15.136:3300/0 conn(0x7f178c0d3c30 0x7f178c0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 -- 172.21.15.142:0/3685286578 >> v1:172.21.15.136:6789/0 conn(0x7f178c15f1c0 legacy=0x7f178c0d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.972+0000 7f1783e00640 1 -- 172.21.15.142:0/3685286578 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c0b8480 con 0x7f178c15f5a0 2024-05-04T07:50:04.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.973+0000 7f1783e00640 1 --2- 172.21.15.142:0/3685286578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1774009870 tx=0x7f177402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b0671747bedc353 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f1789400640 1 -- 172.21.15.142:0/3685286578 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774037070 con 0x7f178c15f5a0 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f1789400640 1 -- 172.21.15.142:0/3685286578 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774032440 con 0x7f178c15f5a0 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f1789400640 1 -- 172.21.15.142:0/3685286578 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774032810 con 0x7f178c15f5a0 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 -- 172.21.15.142:0/3685286578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 msgr2=0x7f178c0d5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 --2- 172.21.15.142:0/3685286578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1774009870 tx=0x7f177402a270 comp rx=0 tx=0).stop 2024-05-04T07:50:04.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 -- 172.21.15.142:0/3685286578 shutdown_connections 2024-05-04T07:50:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 --2- 172.21.15.142:0/3685286578 >> v2:172.21.15.136:3300/0 conn(0x7f178c0d3c30 0x7f178c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 --2- 172.21.15.142:0/3685286578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c15f5a0 0x7f178c0d5a60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 -- 172.21.15.142:0/3685286578 >> 172.21.15.142:0/3685286578 conn(0x7f178c0d4f40 msgr2=0x7f178c0d5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.974+0000 7f178b200640 1 -- 172.21.15.142:0/3685286578 shutdown_connections 2024-05-04T07:50:04.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.975+0000 7f178b200640 1 -- 172.21.15.142:0/3685286578 wait complete. 2024-05-04T07:50:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.976+0000 7f178b200640 1 Processor -- start 2024-05-04T07:50:04.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.976+0000 7f178b200640 1 -- start start 2024-05-04T07:50:04.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 0x7f178c09f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f178c0b6a30 0x7f178c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:04.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0d2d20 con 0x7f178c0b6a30 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0b8a40 con 0x7f178c15f1c0 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f178b200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f178c0d2ea0 con 0x7f178c0d3c30 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f1789e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 0x7f178c09f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f1783e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f1783e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50434/0 (socket says 172.21.15.142:50434) 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.977+0000 7f1783e00640 1 -- 172.21.15.142:0/3949357524 learned_addr learned my addr 172.21.15.142:0/3949357524 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f178a800640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f178c0b6a30 0x7f178c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 -- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 msgr2=0x7f178c09f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 0x7f178c09f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 -- 172.21.15.142:0/3949357524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f178c0b6a30 msgr2=0x7f178c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f178c0b6a30 0x7f178c0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:04.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 -- 172.21.15.142:0/3949357524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c0cee20 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1789e00640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 0x7f178c09f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1783e00640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17740090b0 tx=0x7f17740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774041030 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.978+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1774030440 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.979+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774037040 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.979+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c0a1330 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.979+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c15e2f0 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.979+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1774044070 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.979+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f177403dc40 con 0x7f178c15f1c0 2024-05-04T07:50:04.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.980+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178c069b10 con 0x7f178c15f1c0 2024-05-04T07:50:04.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:04.982+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f177403d650 con 0x7f178c15f1c0 2024-05-04T07:50:05.033 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:05.032+0000 7f8c8c3d3040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-04T07:50:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.061+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8ffaa6b-f025-450e-b0a9-af514bec2462", "id": 6} v 0) -- 0x7f178c0baa10 con 0x7f178c15f1c0 2024-05-04T07:50:05.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.070+0000 7f1782000640 1 -- 172.21.15.142:0/3949357524 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8ffaa6b-f025-450e-b0a9-af514bec2462", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f177403d830 con 0x7f178c15f1c0 2024-05-04T07:50:05.071 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 msgr2=0x7f178c09f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f17740090b0 tx=0x7f17740046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 shutdown_connections 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f178c0b6a30 0x7f178c0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c15f1c0 0x7f178c09f690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 --2- 172.21.15.142:0/3949357524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f178c0d3c30 0x7f178c09f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 >> 172.21.15.142:0/3949357524 conn(0x7f178c0d4f40 msgr2=0x7f178c0d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 shutdown_connections 2024-05-04T07:50:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.072+0000 7f178b200640 1 -- 172.21.15.142:0/3949357524 wait complete. 2024-05-04T07:50:05.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 17244599-2bdd-4fc9-bd49-044c8d9e340c 7 2024-05-04T07:50:05.123 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:05.123+0000 7f70cf212040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-04T07:50:05.264 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.264+0000 7f4192200640 1 Processor -- start 2024-05-04T07:50:05.265 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.264+0000 7f4192200640 1 -- start start 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.265+0000 7f4192200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f418c160450 0x7f418c0d3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.265+0000 7f4192200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.265+0000 7f4192200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c0d02b0 con 0x7f418c0ce940 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.265+0000 7f4192200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f418c0cdf70 con 0x7f418c160450 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.265+0000 7f4192200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f418c0d0590 con 0x7f418c0d1b00 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51986/0 (socket says 172.21.15.142:51986) 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 -- 172.21.15.142:0/56722467 learned_addr learned my addr 172.21.15.142:0/56722467 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f4190e00640 1 --2- 172.21.15.142:0/56722467 >> v2:172.21.15.136:3300/0 conn(0x7f418c160450 0x7f418c0d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 -- 172.21.15.142:0/56722467 >> v2:172.21.15.136:3300/0 conn(0x7f418c160450 msgr2=0x7f418c0d3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 --2- 172.21.15.142:0/56722467 >> v2:172.21.15.136:3300/0 conn(0x7f418c160450 0x7f418c0d3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.267 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 -- 172.21.15.142:0/56722467 >> v1:172.21.15.136:6789/0 conn(0x7f418c0ce940 legacy=0x7f418c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.266+0000 7f418be00640 1 -- 172.21.15.142:0/56722467 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c0cdc00 con 0x7f418c0d1b00 2024-05-04T07:50:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.267+0000 7f418be00640 1 --2- 172.21.15.142:0/56722467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4178009870 tx=0x7f417802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38cc97a89cbfcdc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.267+0000 7f418b400640 1 -- 172.21.15.142:0/56722467 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178037070 con 0x7f418c0d1b00 2024-05-04T07:50:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.267+0000 7f418b400640 1 -- 172.21.15.142:0/56722467 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4178032440 con 0x7f418c0d1b00 2024-05-04T07:50:05.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.267+0000 7f418b400640 1 -- 172.21.15.142:0/56722467 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178032810 con 0x7f418c0d1b00 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 -- 172.21.15.142:0/56722467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 msgr2=0x7f418c0ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 --2- 172.21.15.142:0/56722467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4178009870 tx=0x7f417802a130 comp rx=0 tx=0).stop 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 -- 172.21.15.142:0/56722467 shutdown_connections 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 --2- 172.21.15.142:0/56722467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c0d1b00 0x7f418c0ce400 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 --2- 172.21.15.142:0/56722467 >> v2:172.21.15.136:3300/0 conn(0x7f418c160450 0x7f418c0d3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 -- 172.21.15.142:0/56722467 >> 172.21.15.142:0/56722467 conn(0x7f418c0d2d50 msgr2=0x7f418c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:05.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 -- 172.21.15.142:0/56722467 shutdown_connections 2024-05-04T07:50:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.268+0000 7f4192200640 1 -- 172.21.15.142:0/56722467 wait complete. 2024-05-04T07:50:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.270+0000 7f4192200640 1 Processor -- start 2024-05-04T07:50:05.270 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.270+0000 7f4192200640 1 -- start start 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 0x7f418c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c0d1b00 0x7f418c06e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0cd9a0 con 0x7f418c0d1b00 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0cd820 con 0x7f418c0ce940 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4192200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f418c160830 con 0x7f418c160450 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4190e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 0x7f418c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4191800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4190e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 0x7f418c0c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50450/0 (socket says 172.21.15.142:50450) 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4190e00640 1 -- 172.21.15.142:0/424400365 learned_addr learned my addr 172.21.15.142:0/424400365 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-05-04T07:50:05.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.271+0000 7f4191800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:51992/0 (socket says 172.21.15.142:51992) 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f418be00640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c0d1b00 0x7f418c06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 -- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 msgr2=0x7f418c0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 0x7f418c0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 -- 172.21.15.142:0/424400365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c0d1b00 msgr2=0x7f418c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c0d1b00 0x7f418c06e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 -- 172.21.15.142:0/424400365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c15a260 con 0x7f418c160450 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4191800640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f418400be20 tx=0x7f418400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184019070 con 0x7f418c160450 2024-05-04T07:50:05.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4184014440 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184014870 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c15a540 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.272+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c15ab00 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.273+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f418401c070 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.273+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f418401e440 con 0x7f418c160450 2024-05-04T07:50:05.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.274+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c15aff0 con 0x7f418c160450 2024-05-04T07:50:05.276 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.276+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4184023020 con 0x7f418c160450 2024-05-04T07:50:05.334 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:05.334+0000 7f8c8c3d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T07:50:05.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.354+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "17244599-2bdd-4fc9-bd49-044c8d9e340c", "id": 7} v 0) -- 0x7f418c069b10 con 0x7f418c160450 2024-05-04T07:50:05.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.362+0000 7f4188c00640 1 -- 172.21.15.142:0/424400365 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17244599-2bdd-4fc9-bd49-044c8d9e340c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f418401eb20 con 0x7f418c160450 2024-05-04T07:50:05.363 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 msgr2=0x7f418c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f418400be20 tx=0x7f418400bf10 comp rx=0 tx=0).stop 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 shutdown_connections 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f418c160450 0x7f418c06ea40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c0d1b00 0x7f418c06e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 --2- 172.21.15.142:0/424400365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f418c0ce940 0x7f418c0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.363+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 >> 172.21.15.142:0/424400365 conn(0x7f418c0d2d50 msgr2=0x7f418c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.364+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 shutdown_connections 2024-05-04T07:50:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:50:05.364+0000 7f4192200640 1 -- 172.21.15.142:0/424400365 wait complete. 2024-05-04T07:50:05.380 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-04T07:50:05.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-04T07:50:05.386 INFO:tasks.ceph.osd.0:Started 2024-05-04T07:50:05.386 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-04T07:50:05.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-04T07:50:05.393 INFO:tasks.ceph.osd.1:Started 2024-05-04T07:50:05.393 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-04T07:50:05.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-04T07:50:05.398 INFO:tasks.ceph.osd.2:Started 2024-05-04T07:50:05.398 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-04T07:50:05.399 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-04T07:50:05.403 INFO:tasks.ceph.osd.3:Started 2024-05-04T07:50:05.404 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-04T07:50:05.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-04T07:50:05.404 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:05.401+0000 7f8c8c3d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T07:50:05.430 INFO:tasks.ceph.osd.4:Started 2024-05-04T07:50:05.430 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-04T07:50:05.430 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-04T07:50:05.438 INFO:tasks.ceph.osd.5:Started 2024-05-04T07:50:05.438 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-04T07:50:05.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-04T07:50:05.440 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:05.439+0000 7f70cf212040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T07:50:05.442 INFO:tasks.ceph.osd.6:Started 2024-05-04T07:50:05.443 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-04T07:50:05.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-04T07:50:05.448 INFO:tasks.ceph.osd.7:Started 2024-05-04T07:50:05.449 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:05.521 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:05.521+0000 7f70cf212040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T07:50:05.605 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:05.605+0000 7f8c8c3d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-04T07:50:05.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.644+0000 7f92f7a00640 1 Processor -- start 2024-05-04T07:50:05.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.644+0000 7f92f7a00640 1 -- start start 2024-05-04T07:50:05.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f7a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92f006f9c0 0x7f92f00cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f7a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f0073000 con 0x7f92f006f5e0 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f7a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f00732e0 con 0x7f92f006c3a0 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f7a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f92f0073ef0 con 0x7f92f006f9c0 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92e7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92f006f9c0 0x7f92f00cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f5000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f92f006f5e0 0x7f92f00711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:53728/0 (socket says 172.21.15.136:53728) 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.645+0000 7f92f5000640 1 -- 172.21.15.136:0/1778453741 learned_addr learned my addr 172.21.15.136:0/1778453741 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.646+0000 7f92e7e00640 1 -- 172.21.15.136:0/1778453741 >> v1:172.21.15.142:6789/0 conn(0x7f92f006c3a0 legacy=0x7f92f0160e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.646+0000 7f92e7e00640 1 -- 172.21.15.136:0/1778453741 >> v1:172.21.15.136:6789/0 conn(0x7f92f006f5e0 legacy=0x7f92f00711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.646+0000 7f92e7e00640 1 -- 172.21.15.136:0/1778453741 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f00735c0 con 0x7f92f006f9c0 2024-05-04T07:50:05.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92e7e00640 1 --2- 172.21.15.136:0/1778453741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f9c0 0x7f92f00cc310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097a0 tx=0x7f92d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737f4d6b076be0a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:05.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92efe00640 1 -- 172.21.15.136:0/1778453741 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8037070 con 0x7f92f006f9c0 2024-05-04T07:50:05.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92efe00640 1 -- 172.21.15.136:0/1778453741 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8032440 con 0x7f92f006f9c0 2024-05-04T07:50:05.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92efe00640 1 -- 172.21.15.136:0/1778453741 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8032810 con 0x7f92f006f9c0 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92f7a00640 1 -- 172.21.15.136:0/1778453741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f9c0 msgr2=0x7f92f00cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.647+0000 7f92f7a00640 1 --2- 172.21.15.136:0/1778453741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f9c0 0x7f92f00cc310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92d80097a0 tx=0x7f92d802a230 comp rx=0 tx=0).stop 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.648+0000 7f92f7a00640 1 -- 172.21.15.136:0/1778453741 shutdown_connections 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.648+0000 7f92f7a00640 1 --2- 172.21.15.136:0/1778453741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f9c0 0x7f92f00cc310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.648+0000 7f92f7a00640 1 -- 172.21.15.136:0/1778453741 >> 172.21.15.136:0/1778453741 conn(0x7f92f00d1cc0 msgr2=0x7f92f00d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.648+0000 7f92f7a00640 1 -- 172.21.15.136:0/1778453741 shutdown_connections 2024-05-04T07:50:05.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.648+0000 7f92f7a00640 1 -- 172.21.15.136:0/1778453741 wait complete. 2024-05-04T07:50:05.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.649+0000 7f92f7a00640 1 Processor -- start 2024-05-04T07:50:05.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.650+0000 7f92f7a00640 1 -- start start 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.650+0000 7f92f7a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92f006c3a0 0x7f92f01f9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.650+0000 7f92f7a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f7a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f006f9c0 0x7f92f00b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f7a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00718c0 con 0x7f92f006f5e0 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f7a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92f0073b80 con 0x7f92f006f9c0 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f7a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92f0071a40 con 0x7f92f006c3a0 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f5000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92f006c3a0 0x7f92f01f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50112/0 (socket says 172.21.15.136:50112) 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 -- 172.21.15.136:0/856400726 learned_addr learned my addr 172.21.15.136:0/856400726 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92f5a00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f006f9c0 0x7f92f00b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 -- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92f006c3a0 msgr2=0x7f92f01f9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92f006c3a0 0x7f92f01f9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 -- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f006f9c0 msgr2=0x7f92f00b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f006f9c0 0x7f92f00b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 -- 172.21.15.136:0/856400726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f015e1b0 con 0x7f92f006f5e0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.651+0000 7f92e7e00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92d8035040 tx=0x7f92d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8037040 con 0x7f92f006f5e0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d8030770 con 0x7f92f006f5e0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8030b80 con 0x7f92f006f5e0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f015e490 con 0x7f92f006f5e0 2024-05-04T07:50:05.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f015e770 con 0x7f92f006f5e0 2024-05-04T07:50:05.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f92d8044020 con 0x7f92f006f5e0 2024-05-04T07:50:05.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.652+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f92d8030d20 con 0x7f92f006f5e0 2024-05-04T07:50:05.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.653+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f0069b10 con 0x7f92f006f5e0 2024-05-04T07:50:05.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.655+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f92d8032e20 con 0x7f92f006f5e0 2024-05-04T07:50:05.692 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:05.692+0000 7f70cf212040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-04T07:50:05.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.720+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92f0160890 con 0x7f92f006f5e0 2024-05-04T07:50:05.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.721+0000 7f92ed600640 1 -- 172.21.15.136:0/856400726 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f92d803d7d0 con 0x7f92f006f5e0 2024-05-04T07:50:05.721 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:05.721 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":10,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:05.356694+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:05.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 msgr2=0x7f92f00b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f92d8035040 tx=0x7f92d80046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 shutdown_connections 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92f006f9c0 0x7f92f00b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f006f5e0 0x7f92f00b5e20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 --2- 172.21.15.136:0/856400726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92f006c3a0 0x7f92f01f9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 >> 172.21.15.136:0/856400726 conn(0x7f92f00d1cc0 msgr2=0x7f92f00b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 shutdown_connections 2024-05-04T07:50:05.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:05.722+0000 7f92f7a00640 1 -- 172.21.15.136:0/856400726 wait complete. 2024-05-04T07:50:05.738 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-04T07:50:05.738 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-04T07:50:05.952 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:05.951+0000 7f8c8c3d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T07:50:06.008 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.007+0000 7f8c8c3d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T07:50:06.020 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.019+0000 7f70cf212040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T07:50:06.077 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.076+0000 7f70cf212040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T07:50:06.087 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:06.086+0000 7fee6a1c4640 -1 Falling back to public interface 2024-05-04T07:50:06.087 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-05-04T07:50:06.086+0000 7fdee2823640 -1 Falling back to public interface 2024-05-04T07:50:06.087 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:06.086+0000 7fee68c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-04T07:50:06.090 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:06.089+0000 7fee68c00640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2024-05-04T07:50:06.095 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-05-04T07:50:06.095+0000 7f5313623640 -1 Falling back to public interface 2024-05-04T07:50:06.107 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-05-04T07:50:06.107+0000 7fbb1ddfc640 -1 Falling back to public interface 2024-05-04T07:50:06.112 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-05-04T07:50:06.112+0000 7fc71b863640 -1 Falling back to public interface 2024-05-04T07:50:06.115 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-05-04T07:50:06.115+0000 7f6912a0f640 -1 Falling back to public interface 2024-05-04T07:50:06.119 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-05-04T07:50:06.119+0000 7f8ec521b640 -1 Falling back to public interface 2024-05-04T07:50:06.159 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-05-04T07:50:06.158+0000 7ff59d92c640 -1 Falling back to public interface 2024-05-04T07:50:06.200 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.200+0000 7f8c8c3d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T07:50:06.264 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.263+0000 7f70cf212040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T07:50:06.367 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.367+0000 7f8c8c3d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T07:50:06.428 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.427+0000 7f8c8c3d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T07:50:06.432 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.432+0000 7f70cf212040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T07:50:06.493 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.492+0000 7f70cf212040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T07:50:06.510 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.509+0000 7f8c8c3d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T07:50:06.544 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:06.564 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:06.564+0000 7f8c8c3d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T07:50:06.574 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.573+0000 7f70cf212040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T07:50:06.627 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:06.626+0000 7f70cf212040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T07:50:06.700 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.699+0000 7f81a8e00640 1 Processor -- start 2024-05-04T07:50:06.700 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.699+0000 7f81a8e00640 1 -- start start 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a415f0d0 0x7f81a40cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81a415f4b0 0x7f81a40cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81a40d1ec0 0x7f81a40d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f81a40b42f0 con 0x7f81a415f4b0 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f81a40d23b0 con 0x7f81a40d1ec0 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f81a40d2690 con 0x7f81a415f0d0 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81a415f4b0 0x7f81a40cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81a415f4b0 0x7f81a40cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50114/0 (socket says 172.21.15.136:50114) 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 -- 172.21.15.136:0/3034858019 learned_addr learned my addr 172.21.15.136:0/3034858019 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a3400640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a415f0d0 0x7f81a40cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.702 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a3e00640 1 --2- 172.21.15.136:0/3034858019 >> v2:172.21.15.142:3300/0 conn(0x7f81a40d1ec0 0x7f81a40d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.703 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 -- 172.21.15.136:0/3034858019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a415f0d0 msgr2=0x7f81a40cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:06.703 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a415f0d0 0x7f81a40cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.703 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 -- 172.21.15.136:0/3034858019 >> v2:172.21.15.142:3300/0 conn(0x7f81a40d1ec0 msgr2=0x7f81a40d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:06.703 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 --2- 172.21.15.136:0/3034858019 >> v2:172.21.15.142:3300/0 conn(0x7f81a40d1ec0 0x7f81a40d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.703 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.701+0000 7f81a2a00640 1 -- 172.21.15.136:0/3034858019 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a40b4540 con 0x7f81a415f4b0 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.702+0000 7f81a2a00640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a415f4b0 0x7f81a40cfed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81a40d10f0 tx=0x7f819002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6a4fb2e984f5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a2000640 1 -- 172.21.15.136:0/3034858019 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190037070 con 0x7f81a415f4b0 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a2000640 1 -- 172.21.15.136:0/3034858019 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8190032440 con 0x7f81a415f4b0 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a2000640 1 -- 172.21.15.136:0/3034858019 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8190032810 con 0x7f81a415f4b0 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 -- 172.21.15.136:0/3034858019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a415f4b0 msgr2=0x7f81a40cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a415f4b0 0x7f81a40cfed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81a40d10f0 tx=0x7f819002a1e0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 -- 172.21.15.136:0/3034858019 shutdown_connections 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 --2- 172.21.15.136:0/3034858019 >> v2:172.21.15.142:3300/0 conn(0x7f81a40d1ec0 0x7f81a40d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a415f4b0 0x7f81a40cfed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 --2- 172.21.15.136:0/3034858019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a415f0d0 0x7f81a40cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 -- 172.21.15.136:0/3034858019 >> 172.21.15.136:0/3034858019 conn(0x7f81a40d4ec0 msgr2=0x7f81a40d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.703+0000 7f81a8e00640 1 -- 172.21.15.136:0/3034858019 shutdown_connections 2024-05-04T07:50:06.705 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.704+0000 7f81a8e00640 1 -- 172.21.15.136:0/3034858019 wait complete. 2024-05-04T07:50:06.706 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.705+0000 7f81a8e00640 1 Processor -- start 2024-05-04T07:50:06.706 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.705+0000 7f81a8e00640 1 -- start start 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 0x7f81a40b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 0x7f81a4160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81a40d2e20 con 0x7f81a40d1ec0 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81a40d2ca0 con 0x7f81a415f0d0 2024-05-04T07:50:06.708 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f81a40d2fa0 con 0x7f81a40b8f50 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50118/0 (socket says 172.21.15.136:50118) 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a3400640 1 -- 172.21.15.136:0/4141627182 learned_addr learned my addr 172.21.15.136:0/4141627182 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.706+0000 7f81a2a00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 0x7f81a40b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 0x7f81a4160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 -- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 msgr2=0x7f81a4160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 0x7f81a4160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 -- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 msgr2=0x7f81a40b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 0x7f81a40b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 -- 172.21.15.136:0/4141627182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a415fbf0 con 0x7f81a40d1ec0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a2a00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 0x7f81a40b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 0x7f81a4160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a3400640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f819400d800 tx=0x7f819400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819400b6c0 con 0x7f81a40d1ec0 2024-05-04T07:50:06.709 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8194019070 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819400ba80 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.707+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a415fed0 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.708+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a4160490 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.708+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f819400bc20 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.708+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f819401eb30 con 0x7f81a40d1ec0 2024-05-04T07:50:06.710 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.709+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a4050740 con 0x7f81a40d1ec0 2024-05-04T07:50:06.711 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.711+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f819401e460 con 0x7f81a40d1ec0 2024-05-04T07:50:06.776 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.776+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81a40b39c0 con 0x7f81a40d1ec0 2024-05-04T07:50:06.777 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.777+0000 7f819b400640 1 -- 172.21.15.136:0/4141627182 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f819401e640 con 0x7f81a40d1ec0 2024-05-04T07:50:06.778 INFO:teuthology.misc.health.smithi136.stdout: 2024-05-04T07:50:06.778 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":10,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:05.356694+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 msgr2=0x7f81a41544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f819400d800 tx=0x7f819400dcc0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 shutdown_connections 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a40b8f50 0x7f81a4160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a415f0d0 0x7f81a40b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 --2- 172.21.15.136:0/4141627182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81a40d1ec0 0x7f81a41544e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.778+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 >> 172.21.15.136:0/4141627182 conn(0x7f81a40d4ec0 msgr2=0x7f81a406ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.779+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 shutdown_connections 2024-05-04T07:50:06.779 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:06.779+0000 7f81a8e00640 1 -- 172.21.15.136:0/4141627182 wait complete. 2024-05-04T07:50:06.791 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-04T07:50:07.118 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:07.118+0000 7f8c8c3d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T07:50:07.173 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:07.172+0000 7f70cf212040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T07:50:07.251 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:07.250+0000 7f8c8c3d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T07:50:07.312 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-05-04T07:50:07.311+0000 7f70cf212040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T07:50:08.294 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:08.293+0000 7f8c2c200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-04T07:50:08.295 INFO:tasks.ceph.mgr.y.smithi136.stderr:2024-05-04T07:50:08.295+0000 7f8c2c200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-04T07:50:09.462 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-05-04T07:50:09.462+0000 7fc71b863640 -1 osd.4 0 log_to_monitors true 2024-05-04T07:50:09.486 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-05-04T07:50:09.486+0000 7f8ec521b640 -1 osd.2 0 log_to_monitors true 2024-05-04T07:50:09.698 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-05-04T07:50:09.698+0000 7f6912a0f640 -1 osd.6 0 log_to_monitors true 2024-05-04T07:50:09.718 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-05-04T07:50:09.717+0000 7fbb1ddfc640 -1 osd.5 0 log_to_monitors true 2024-05-04T07:50:09.773 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-05-04T07:50:09.773+0000 7fdee2823640 -1 osd.1 0 log_to_monitors true 2024-05-04T07:50:09.774 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:09.773+0000 7fee6a1c4640 -1 osd.0 0 log_to_monitors true 2024-05-04T07:50:09.779 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-05-04T07:50:09.779+0000 7f5313623640 -1 osd.3 0 log_to_monitors true 2024-05-04T07:50:09.785 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-05-04T07:50:09.785+0000 7ff59d92c640 -1 osd.7 0 log_to_monitors true 2024-05-04T07:50:13.087 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-05-04T07:50:13.085+0000 7f530e400640 -1 osd.3 0 waiting for initial osdmap 2024-05-04T07:50:13.094 INFO:tasks.ceph.osd.3.smithi136.stderr:2024-05-04T07:50:13.093+0000 7f5304400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.106 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-05-04T07:50:13.105+0000 7f8ebfc00640 -1 osd.2 0 waiting for initial osdmap 2024-05-04T07:50:13.114 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:13.114+0000 7fee65000640 -1 osd.0 0 waiting for initial osdmap 2024-05-04T07:50:13.116 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-05-04T07:50:13.116+0000 7fdedd200640 -1 osd.1 0 waiting for initial osdmap 2024-05-04T07:50:13.118 INFO:tasks.ceph.osd.0.smithi136.stderr:2024-05-04T07:50:13.118+0000 7fee5b000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.119 INFO:tasks.ceph.osd.2.smithi136.stderr:2024-05-04T07:50:13.119+0000 7f8eb5c00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.143 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-05-04T07:50:13.143+0000 7fded3200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.599 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:13.657 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:50:13.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:50:13.720 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-05-04T07:50:13.719+0000 7f690dc00640 -1 osd.6 0 waiting for initial osdmap 2024-05-04T07:50:13.731 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-05-04T07:50:13.731+0000 7ff599200640 -1 osd.7 0 waiting for initial osdmap 2024-05-04T07:50:13.736 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-05-04T07:50:13.736+0000 7f6903200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.742 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-05-04T07:50:13.742+0000 7ff58e800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.749 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-05-04T07:50:13.747+0000 7fbb18c00640 -1 osd.5 0 waiting for initial osdmap 2024-05-04T07:50:13.752 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-05-04T07:50:13.752+0000 7fbb0ec00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.787 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.786+0000 7f2c77200640 1 Processor -- start 2024-05-04T07:50:13.787 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.787+0000 7f2c77200640 1 -- start start 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c77200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2c7015f160 0x7f2c70163840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c77200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 0x7f2c700d3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c77200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c700d00f0 con 0x7f2c700cfc10 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c77200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2c70163d80 con 0x7f2c7015f160 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c77200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700d03d0 con 0x7f2c7015f540 2024-05-04T07:50:13.789 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c75200640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2c700cfc10 0x7f2c700b5b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:41244/0 (socket says 172.21.15.136:41244) 2024-05-04T07:50:13.790 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c75200640 1 -- 172.21.15.136:0/3163334644 learned_addr learned my addr 172.21.15.136:0/3163334644 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:13.790 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c67400640 1 --2- 172.21.15.136:0/3163334644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 0x7f2c700d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.790 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.788+0000 7f2c6fe00640 1 --2- 172.21.15.136:0/3163334644 >> v2:172.21.15.142:3300/0 conn(0x7f2c7015f160 0x7f2c70163840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.793 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c6f400640 1 -- 172.21.15.136:0/3163334644 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129977111 0 0) 0x7f2c700d00f0 con 0x7f2c700cfc10 2024-05-04T07:50:13.793 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c6f400640 1 -- 172.21.15.136:0/3163334644 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c54003520 con 0x7f2c700cfc10 2024-05-04T07:50:13.793 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c67400640 1 -- 172.21.15.136:0/3163334644 >> v2:172.21.15.142:3300/0 conn(0x7f2c7015f160 msgr2=0x7f2c70163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c67400640 1 --2- 172.21.15.136:0/3163334644 >> v2:172.21.15.142:3300/0 conn(0x7f2c7015f160 0x7f2c70163840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c67400640 1 -- 172.21.15.136:0/3163334644 >> v1:172.21.15.142:6789/0 conn(0x7f2c700cfc10 legacy=0x7f2c700b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.789+0000 7f2c67400640 1 -- 172.21.15.136:0/3163334644 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700d06b0 con 0x7f2c7015f540 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.790+0000 7f2c67400640 1 --2- 172.21.15.136:0/3163334644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 0x7f2c700d3530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097a0 tx=0x7f2c5802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d34b81b7b738106a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.790+0000 7f2c6f400640 1 -- 172.21.15.136:0/3163334644 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58037070 con 0x7f2c7015f540 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.790+0000 7f2c6f400640 1 -- 172.21.15.136:0/3163334644 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5802ae50 con 0x7f2c7015f540 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.790+0000 7f2c6f400640 1 -- 172.21.15.136:0/3163334644 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58032640 con 0x7f2c7015f540 2024-05-04T07:50:13.794 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 -- 172.21.15.136:0/3163334644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 msgr2=0x7f2c700d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 --2- 172.21.15.136:0/3163334644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 0x7f2c700d3530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097a0 tx=0x7f2c5802a100 comp rx=0 tx=0).stop 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 -- 172.21.15.136:0/3163334644 shutdown_connections 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 --2- 172.21.15.136:0/3163334644 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c7015f540 0x7f2c700d3530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 --2- 172.21.15.136:0/3163334644 >> v2:172.21.15.142:3300/0 conn(0x7f2c7015f160 0x7f2c70163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 -- 172.21.15.136:0/3163334644 >> 172.21.15.136:0/3163334644 conn(0x7f2c7009e2c0 msgr2=0x7f2c700d4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 -- 172.21.15.136:0/3163334644 shutdown_connections 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.791+0000 7f2c77200640 1 -- 172.21.15.136:0/3163334644 wait complete. 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.793+0000 7f2c77200640 1 Processor -- start 2024-05-04T07:50:13.795 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.793+0000 7f2c77200640 1 -- start start 2024-05-04T07:50:13.796 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-05-04T07:50:13.791+0000 7fc716800640 -1 osd.4 0 waiting for initial osdmap 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c700cfc10 0x7f2c7014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c700cb160 0x7f2c7009ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700d3a70 con 0x7f2c700cfc10 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700d5b00 con 0x7f2c7015f160 2024-05-04T07:50:13.800 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c77200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700d3bf0 con 0x7f2c700cb160 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c6fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c700cfc10 0x7f2c7014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:34838/0 (socket says 172.21.15.136:34838) 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 -- 172.21.15.136:0/766004851 learned_addr learned my addr 172.21.15.136:0/766004851 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c75200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c700cb160 0x7f2c7009ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 -- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c700cb160 msgr2=0x7f2c7009ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c700cb160 0x7f2c7009ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 -- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c700cfc10 msgr2=0x7f2c7014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c700cfc10 0x7f2c7014f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.794+0000 7f2c67400640 1 -- 172.21.15.136:0/766004851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700a0b40 con 0x7f2c7015f160 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c67400640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097a0 tx=0x7f2c580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58041020 con 0x7f2c7015f160 2024-05-04T07:50:13.801 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c580044c0 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7014fef0 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58037040 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.795+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c701504b0 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.796+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c70069d30 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.797+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f2c58044020 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.798+0000 7f2c6cc00640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 0x7f2c4c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.798+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f2c580b69a0 con 0x7f2c7015f160 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.798+0000 7f2c6fe00640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 0x7f2c4c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:13.802 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.799+0000 7f2c6fe00640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 0x7f2c4c078700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009b40 tx=0x7f2c60009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:13.803 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-05-04T07:50:13.796+0000 7fc70c800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T07:50:13.804 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.804+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c5804b030 con 0x7f2c7015f160 2024-05-04T07:50:13.999 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:13.999+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c700d2180 con 0x7f2c7015f160 2024-05-04T07:50:14.001 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.000+0000 7f2c6cc00640 1 -- 172.21.15.136:0/766004851 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f2c58081160 con 0x7f2c7015f160 2024-05-04T07:50:14.001 INFO:teuthology.misc.health.smithi136.stdout: 2024-05-04T07:50:14.001 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":12,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:11.288529+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 msgr2=0x7f2c4c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 0x7f2c4c078700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009b40 tx=0x7f2c60009190 comp rx=0 tx=0).stop 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 msgr2=0x7f2c700cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097a0 tx=0x7f2c580046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 shutdown_connections 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2c4c076240 0x7f2c4c078700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c700cb160 0x7f2c7009ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:14.004 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c7015f160 0x7f2c700cac20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:14.005 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 --2- 172.21.15.136:0/766004851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c700cfc10 0x7f2c7014f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:14.005 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 >> 172.21.15.136:0/766004851 conn(0x7f2c7009e2c0 msgr2=0x7f2c70068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:14.005 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.003+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 shutdown_connections 2024-05-04T07:50:14.005 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:14.004+0000 7f2c77200640 1 -- 172.21.15.136:0/766004851 wait complete. 2024-05-04T07:50:14.017 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-04T07:50:20.824 DEBUG:teuthology.orchestra.run.smithi136:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:21.010 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.008+0000 7f3bb7000640 1 Processor -- start 2024-05-04T07:50:21.010 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.008+0000 7f3bb7000640 1 -- start start 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3bb01635c0 0x7f3bb00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb01639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bb0163ee0 0x7f3bb006e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb0167f90 con 0x7f3bb01635c0 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb00b4510 con 0x7f3bb0163ee0 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bb7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb00b47f0 con 0x7f3bb0167b30 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bafe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3bb01635c0 0x7f3bb00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.012 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bafe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3bb01635c0 0x7f3bb00b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60370/0 (socket says 172.21.15.136:60370) 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.010+0000 7f3bafe00640 1 -- 172.21.15.136:0/3528645524 learned_addr learned my addr 172.21.15.136:0/3528645524 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3baf400640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb01639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bb5000640 1 --2- 172.21.15.136:0/3528645524 >> v2:172.21.15.142:3300/0 conn(0x7f3bb0163ee0 0x7f3bb006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bafe00640 1 -- 172.21.15.136:0/3528645524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 msgr2=0x7f3bb01639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb01639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.013 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bafe00640 1 -- 172.21.15.136:0/3528645524 >> v2:172.21.15.142:3300/0 conn(0x7f3bb0163ee0 msgr2=0x7f3bb006e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:21.014 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3528645524 >> v2:172.21.15.142:3300/0 conn(0x7f3bb0163ee0 0x7f3bb006e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.014 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.011+0000 7f3bafe00640 1 -- 172.21.15.136:0/3528645524 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb0072640 con 0x7f3bb01635c0 2024-05-04T07:50:21.014 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.012+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb00b3de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d1710 tx=0x7f3ba002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35c7fe92e33f985 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.012+0000 7f3baea00640 1 -- 172.21.15.136:0/3528645524 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037070 con 0x7f3bb01635c0 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.012+0000 7f3baea00640 1 -- 172.21.15.136:0/3528645524 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba0032440 con 0x7f3bb01635c0 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.012+0000 7f3baea00640 1 -- 172.21.15.136:0/3528645524 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0032810 con 0x7f3bb01635c0 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 -- 172.21.15.136:0/3528645524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 msgr2=0x7f3bb00b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb00b3de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d1710 tx=0x7f3ba002a140 comp rx=0 tx=0).stop 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 -- 172.21.15.136:0/3528645524 shutdown_connections 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb01639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3528645524 >> v2:172.21.15.142:3300/0 conn(0x7f3bb0163ee0 0x7f3bb006e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3528645524 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb00b3de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 -- 172.21.15.136:0/3528645524 >> 172.21.15.136:0/3528645524 conn(0x7f3bb006f5d0 msgr2=0x7f3bb006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 -- 172.21.15.136:0/3528645524 shutdown_connections 2024-05-04T07:50:21.015 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.013+0000 7f3bb7000640 1 -- 172.21.15.136:0/3528645524 wait complete. 2024-05-04T07:50:21.016 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.015+0000 7f3bb7000640 1 Processor -- start 2024-05-04T07:50:21.016 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.015+0000 7f3bb7000640 1 -- start start 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb0163ee0 0x7f3bb00aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb00aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb006ecd0 con 0x7f3bb01635c0 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb00b4ad0 con 0x7f3bb0163ee0 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bb7000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb006ee50 con 0x7f3bb0167b30 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60378/0 (socket says 172.21.15.136:60378) 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.016+0000 7f3bafe00640 1 -- 172.21.15.136:0/3308091021 learned_addr learned my addr 172.21.15.136:0/3308091021 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:21.019 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bb5000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb00aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3baf400640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb0163ee0 0x7f3bb00aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 -- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 msgr2=0x7f3bb00aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb00aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 -- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb0163ee0 msgr2=0x7f3bb00aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb0163ee0 0x7f3bb00aa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 -- 172.21.15.136:0/3308091021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb00ab240 con 0x7f3bb01635c0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bafe00640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ba002a180 tx=0x7f3ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0041020 con 0x7f3bb01635c0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba00306c0 con 0x7f3bb01635c0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037040 con 0x7f3bb01635c0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.017+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb00ab520 con 0x7f3bb01635c0 2024-05-04T07:50:21.020 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.018+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb00abae0 con 0x7f3bb01635c0 2024-05-04T07:50:21.021 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.019+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb0069d30 con 0x7f3bb01635c0 2024-05-04T07:50:21.021 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.020+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ba0044020 con 0x7f3bb01635c0 2024-05-04T07:50:21.022 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.021+0000 7f3ba7e00640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 0x7f3b90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.022 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.021+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3ba00b7b10 con 0x7f3bb01635c0 2024-05-04T07:50:21.023 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.021+0000 7f3baf400640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 0x7f3b90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.023 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.022+0000 7f3baf400640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 0x7f3b90078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006fd0 tx=0x7f3b9c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.028 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.027+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ba004b030 con 0x7f3bb01635c0 2024-05-04T07:50:21.235 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.233+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bb00d1be0 con 0x7f3bb01635c0 2024-05-04T07:50:21.236 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.235+0000 7f3ba7e00640 1 -- 172.21.15.136:0/3308091021 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12944 (secure 0 0 0) 0x7f3ba0081720 con 0x7f3bb01635c0 2024-05-04T07:50:21.236 INFO:teuthology.misc.health.smithi136.stdout: 2024-05-04T07:50:21.237 INFO:teuthology.misc.health.smithi136.stdout:{"epoch":16,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:17.341263+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:21.239 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 msgr2=0x7f3b90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.239 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 0x7f3b90078790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006fd0 tx=0x7f3b9c008040 comp rx=0 tx=0).stop 2024-05-04T07:50:21.239 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 msgr2=0x7f3bb0151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.239 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ba002a180 tx=0x7f3ba00046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 shutdown_connections 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3b900762d0 0x7f3b90078790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bb0167b30 0x7f3bb00aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bb0163ee0 0x7f3bb00aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 --2- 172.21.15.136:0/3308091021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3bb01635c0 0x7f3bb0151180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.237+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 >> 172.21.15.136:0/3308091021 conn(0x7f3bb006f5d0 msgr2=0x7f3bb00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.238+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 shutdown_connections 2024-05-04T07:50:21.240 INFO:teuthology.misc.health.smithi136.stderr:2024-05-04T07:50:21.238+0000 7f3bb7000640 1 -- 172.21.15.136:0/3308091021 wait complete. 2024-05-04T07:50:21.254 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-04T07:50:21.254 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-04T07:50:21.255 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-04T07:50:21.255 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-04T07:50:21.261 INFO:tasks.ceph.mds.a:Started 2024-05-04T07:50:21.261 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-04T07:50:21.261 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-04T07:50:21.266 INFO:tasks.ceph.mds.c:Started 2024-05-04T07:50:21.266 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-04T07:50:21.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-04T07:50:21.274 INFO:tasks.ceph.mds.b:Started 2024-05-04T07:50:21.274 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-04T07:50:21.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-04T07:50:21.281 INFO:tasks.ceph.mds.d:Started 2024-05-04T07:50:21.282 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-04T07:50:21.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:21.411 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2024-05-04T07:50:21.413 INFO:tasks.ceph.mds.c.smithi136.stdout:starting mds.c at 2024-05-04T07:50:21.433 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-05-04T07:50:21.444 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-05-04T07:50:21.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.460+0000 7ff8bc200640 1 Processor -- start 2024-05-04T07:50:21.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.460+0000 7ff8bc200640 1 -- start start 2024-05-04T07:50:21.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 0x7ff8b40c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff8b40cb490 0x7ff8b40cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b40c75f0 con 0x7ff8b40cb490 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b40cbe20 con 0x7ff8b414d150 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.461+0000 7ff8bc200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40cfe20 con 0x7ff8b414cd70 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff8b40cb490 0x7ff8b40cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff8b40cb490 0x7ff8b40cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60436/0 (socket says 172.21.15.136:60436) 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 -- 172.21.15.136:0/319915639 learned_addr learned my addr 172.21.15.136:0/319915639 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8b9800640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/319915639 >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 0x7ff8b40c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 -- 172.21.15.136:0/319915639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 msgr2=0x7ff8b40c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b40c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 -- 172.21.15.136:0/319915639 >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 msgr2=0x7ff8b40c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:21.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 --2- 172.21.15.136:0/319915639 >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 0x7ff8b40c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8ba200640 1 -- 172.21.15.136:0/319915639 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b40c7030 con 0x7ff8b40cb490 2024-05-04T07:50:21.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.462+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/319915639 >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 0x7ff8b40c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.463+0000 7ff8ba200640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b40cb8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40755b0 tx=0x7ff8ac02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305f790b568a94be server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8b3e00640 1 -- 172.21.15.136:0/319915639 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac036070 con 0x7ff8b40cb490 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8b3e00640 1 -- 172.21.15.136:0/319915639 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac031600 con 0x7ff8b40cb490 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8b3e00640 1 -- 172.21.15.136:0/319915639 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0319d0 con 0x7ff8b40cb490 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 -- 172.21.15.136:0/319915639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 msgr2=0x7ff8b40cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b40cb8e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40755b0 tx=0x7ff8ac02a6c0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 -- 172.21.15.136:0/319915639 shutdown_connections 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b40cb8e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 --2- 172.21.15.136:0/319915639 >> v2:172.21.15.142:3300/0 conn(0x7ff8b414d150 0x7ff8b40c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 --2- 172.21.15.136:0/319915639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 -- 172.21.15.136:0/319915639 >> 172.21.15.136:0/319915639 conn(0x7ff8b40d0c30 msgr2=0x7ff8b40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:21.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 -- 172.21.15.136:0/319915639 shutdown_connections 2024-05-04T07:50:21.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.464+0000 7ff8bc200640 1 -- 172.21.15.136:0/319915639 wait complete. 2024-05-04T07:50:21.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.466+0000 7ff8bc200640 1 Processor -- start 2024-05-04T07:50:21.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.466+0000 7ff8bc200640 1 -- start start 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b4166570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b414d150 0x7ff8b406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4072370 con 0x7ff8b40cb490 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b4072090 con 0x7ff8b414d150 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8bc200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40ceb50 con 0x7ff8b414cd70 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8b9800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8b9800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60446/0 (socket says 172.21.15.136:60446) 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8b9800640 1 -- 172.21.15.136:0/1988079623 learned_addr learned my addr 172.21.15.136:0/1988079623 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8ba200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b414d150 0x7ff8b406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.467+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b4166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 -- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 msgr2=0x7ff8b4166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b4166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 -- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b414d150 msgr2=0x7ff8b406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b414d150 0x7ff8b406e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 -- 172.21.15.136:0/1988079623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b4146ad0 con 0x7ff8b40cb490 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b4166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b9800640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e8c0 tx=0x7ff8a800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8017070 con 0x7ff8b40cb490 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a800c940 con 0x7ff8b40cb490 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800cd10 con 0x7ff8b40cb490 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b4146db0 con 0x7ff8b40cb490 2024-05-04T07:50:21.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.468+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b4147370 con 0x7ff8b40cb490 2024-05-04T07:50:21.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.470+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b4069400 con 0x7ff8b40cb490 2024-05-04T07:50:21.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.471+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff8a801a070 con 0x7ff8b40cb490 2024-05-04T07:50:21.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.472+0000 7ff8b1600640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 0x7ff894078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:21.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.472+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff8a8097600 con 0x7ff8b40cb490 2024-05-04T07:50:21.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.472+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 0x7ff894078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:21.474 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.472+0000 7ff8b8e00640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 0x7ff894078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4166500 tx=0x7ff8a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:21.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.476+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8a8060bc0 con 0x7ff8b40cb490 2024-05-04T07:50:21.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.708+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8b40741b0 con 0x7ff8b40cb490 2024-05-04T07:50:21.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.710+0000 7ff8b1600640 1 -- 172.21.15.136:0/1988079623 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7ff8a8069070 con 0x7ff8b40cb490 2024-05-04T07:50:21.712 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:21.712 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-04T07:50:21.712 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 2 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 msgr2=0x7ff894078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 0x7ff894078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4166500 tx=0x7ff8a0008040 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 msgr2=0x7ff8b4147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e8c0 tx=0x7ff8a800ed80 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 shutdown_connections 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8940762d0 0x7ff894078790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b414d150 0x7ff8b406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b414cd70 0x7ff8b4166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 --2- 172.21.15.136:0/1988079623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8b40cb490 0x7ff8b4147b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:21.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 >> 172.21.15.136:0/1988079623 conn(0x7ff8b40d0c30 msgr2=0x7ff8b40b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:21.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 shutdown_connections 2024-05-04T07:50:21.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:21.713+0000 7ff8bc200640 1 -- 172.21.15.136:0/1988079623 wait complete. 2024-05-04T07:50:23.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:23.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.941+0000 7fdc47400640 1 Processor -- start 2024-05-04T07:50:23.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.942+0000 7fdc47400640 1 -- start start 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.943+0000 7fdc47400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdc40071ef0 0x7fdc40072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.943+0000 7fdc47400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 0x7fdc400c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.943+0000 7fdc47400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc40146900 con 0x7fdc4013ff40 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.943+0000 7fdc47400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdc40140320 con 0x7fdc40071ef0 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.943+0000 7fdc47400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdc40072890 con 0x7fdc400c5ab0 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdc40071ef0 0x7fdc40072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdc40071ef0 0x7fdc40072350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46634/0 (socket says 172.21.15.136:46634) 2024-05-04T07:50:23.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 -- 172.21.15.136:0/2580271741 learned_addr learned my addr 172.21.15.136:0/2580271741 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:23.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc45400640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 0x7fdc400c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 -- 172.21.15.136:0/2580271741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 msgr2=0x7fdc400c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:23.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 0x7fdc400c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 -- 172.21.15.136:0/2580271741 >> v1:172.21.15.142:6789/0 conn(0x7fdc4013ff40 legacy=0x7fdc40145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc3fe00640 1 -- 172.21.15.136:0/2580271741 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4015d7f0 con 0x7fdc40071ef0 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.944+0000 7fdc45400640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 0x7fdc400c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.945+0000 7fdc3fe00640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc40071ef0 0x7fdc40072350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0342870dfefe45 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.946+0000 7fdc3f400640 1 -- 172.21.15.136:0/2580271741 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037070 con 0x7fdc40071ef0 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.946+0000 7fdc3f400640 1 -- 172.21.15.136:0/2580271741 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c032440 con 0x7fdc40071ef0 2024-05-04T07:50:23.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.946+0000 7fdc3f400640 1 -- 172.21.15.136:0/2580271741 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c032810 con 0x7fdc40071ef0 2024-05-04T07:50:23.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.946+0000 7fdc47400640 1 -- 172.21.15.136:0/2580271741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc40071ef0 msgr2=0x7fdc40072350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:23.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.946+0000 7fdc47400640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc40071ef0 0x7fdc40072350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c02a1c0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 -- 172.21.15.136:0/2580271741 shutdown_connections 2024-05-04T07:50:23.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc400c5ab0 0x7fdc400c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.948 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 --2- 172.21.15.136:0/2580271741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc40071ef0 0x7fdc40072350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 -- 172.21.15.136:0/2580271741 >> 172.21.15.136:0/2580271741 conn(0x7fdc400d0c30 msgr2=0x7fdc400d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:23.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 -- 172.21.15.136:0/2580271741 shutdown_connections 2024-05-04T07:50:23.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.947+0000 7fdc47400640 1 -- 172.21.15.136:0/2580271741 wait complete. 2024-05-04T07:50:23.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.949+0000 7fdc47400640 1 Processor -- start 2024-05-04T07:50:23.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.949+0000 7fdc47400640 1 -- start start 2024-05-04T07:50:23.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.950+0000 7fdc47400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc40071ef0 0x7fdc4013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.950+0000 7fdc47400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.950+0000 7fdc47400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 0x7fdc400b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc47400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc40161910 con 0x7fdc400c5ab0 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc47400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4015de40 con 0x7fdc40071ef0 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc47400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4015d4a0 con 0x7fdc4013ff40 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46644/0 (socket says 172.21.15.136:46644) 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 -- 172.21.15.136:0/1402287729 learned_addr learned my addr 172.21.15.136:0/1402287729 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc44a00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc40071ef0 0x7fdc4013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc45400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 0x7fdc400b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 -- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 msgr2=0x7fdc400b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 0x7fdc400b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 -- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc40071ef0 msgr2=0x7fdc4013dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:23.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc40071ef0 0x7fdc4013dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:23.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc3fe00640 1 -- 172.21.15.136:0/1402287729 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4013c210 con 0x7fdc400c5ab0 2024-05-04T07:50:23.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.951+0000 7fdc45400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 0x7fdc400b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:23.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc3fe00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:23.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c037040 con 0x7fdc400c5ab0 2024-05-04T07:50:23.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c042070 con 0x7fdc400c5ab0 2024-05-04T07:50:23.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c030bb0 con 0x7fdc400c5ab0 2024-05-04T07:50:23.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4015a280 con 0x7fdc400c5ab0 2024-05-04T07:50:23.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.952+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4013d1c0 con 0x7fdc400c5ab0 2024-05-04T07:50:23.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.953+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc40069400 con 0x7fdc400c5ab0 2024-05-04T07:50:23.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.954+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc2c02ad10 con 0x7fdc400c5ab0 2024-05-04T07:50:23.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.955+0000 7fdc3cc00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 0x7fdc200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:23.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.956+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdc2c0b7c40 con 0x7fdc400c5ab0 2024-05-04T07:50:23.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.956+0000 7fdc44a00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 0x7fdc200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:23.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.956+0000 7fdc44a00640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 0x7fdc200787c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc34006fd0 tx=0x7fdc34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:23.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:23.961+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc2c081850 con 0x7fdc400c5ab0 2024-05-04T07:50:24.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.200+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc400c7970 con 0x7fdc400c5ab0 2024-05-04T07:50:24.203 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.201+0000 7fdc3cc00640 1 -- 172.21.15.136:0/1402287729 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7fdc2c081150 con 0x7fdc400c5ab0 2024-05-04T07:50:24.203 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:24.203 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-04T07:50:24.203 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 3 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 msgr2=0x7fdc200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 0x7fdc200787c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc34006fd0 tx=0x7fdc34008040 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 msgr2=0x7fdc4013cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009870 tx=0x7fdc2c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 shutdown_connections 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdc20076300 0x7fdc200787c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc4013ff40 0x7fdc400b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc400c5ab0 0x7fdc4013cc80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 --2- 172.21.15.136:0/1402287729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc40071ef0 0x7fdc4013dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 >> 172.21.15.136:0/1402287729 conn(0x7fdc400d0c30 msgr2=0x7fdc40160890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 shutdown_connections 2024-05-04T07:50:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.204+0000 7fdc47400640 1 -- 172.21.15.136:0/1402287729 wait complete. 2024-05-04T07:50:24.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-04T07:50:24.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.415+0000 7f92db400640 1 Processor -- start 2024-05-04T07:50:24.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.415+0000 7f92db400640 1 -- start start 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92db400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92d4071ef0 0x7f92d4072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92db400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d4146900 con 0x7f92d413ff40 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92db400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d415d7f0 con 0x7f92d40c5ab0 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92db400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f92d4140320 con 0x7f92d4071ef0 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92d8a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f92d413ff40 0x7f92d4145e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55282/0 (socket says 172.21.15.136:55282) 2024-05-04T07:50:24.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92d8a00640 1 -- 172.21.15.136:0/3746518999 learned_addr learned my addr 172.21.15.136:0/3746518999 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:24.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781771425 0 0) 0x7f92d4146900 con 0x7f92d413ff40 2024-05-04T07:50:24.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92bc003520 con 0x7f92d413ff40 2024-05-04T07:50:24.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.417+0000 7f92d3e00640 1 --2- 172.21.15.136:0/3746518999 >> v2:172.21.15.142:3300/0 conn(0x7f92d4071ef0 0x7f92d4072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370836887 0 0) 0x7f92bc003520 con 0x7f92d413ff40 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 >> v2:172.21.15.142:3300/0 conn(0x7f92d4071ef0 msgr2=0x7f92d4072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 --2- 172.21.15.136:0/3746518999 >> v2:172.21.15.142:3300/0 conn(0x7f92d4071ef0 0x7f92d4072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 >> v1:172.21.15.142:6789/0 conn(0x7f92d40c5ab0 legacy=0x7f92d40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d415dad0 con 0x7f92d413ff40 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f92c80016f0 con 0x7f92d413ff40 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 >> v1:172.21.15.136:6789/0 conn(0x7f92d413ff40 legacy=0x7f92d4145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92bc003a70 0x7f92bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92bc0052e0 0x7f92bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc00c180 con 0x7f92bc004800 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc00c330 con 0x7f92bc003a70 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc00c530 con 0x7f92bc0052e0 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3e00640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d8a00640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92bc003a70 0x7f92bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3e00640 1 -- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92bc0052e0 msgr2=0x7f92bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d9400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92bc0052e0 0x7f92bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3e00640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92bc0052e0 0x7f92bc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3e00640 1 -- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92bc003a70 msgr2=0x7f92bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.418+0000 7f92d3e00640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92bc003a70 0x7f92bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.419+0000 7f92d3e00640 1 -- 172.21.15.136:0/3746518999 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc003520 con 0x7f92bc004800 2024-05-04T07:50:24.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.419+0000 7f92d9400640 1 -- 172.21.15.136:0/3746518999 reap_dead start 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92d3e00640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ba00 tx=0x7f92bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a84b748342c1f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0030070 con 0x7f92bc004800 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c002ad80 con 0x7f92bc004800 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92d3400640 1 -- 172.21.15.136:0/3746518999 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c000b600 con 0x7f92bc004800 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92db400640 1 -- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 msgr2=0x7f92bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92db400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ba00 tx=0x7f92bc005830 comp rx=0 tx=0).stop 2024-05-04T07:50:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92db400640 1 -- 172.21.15.136:0/3746518999 shutdown_connections 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92db400640 1 --2- 172.21.15.136:0/3746518999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.420+0000 7f92db400640 1 -- 172.21.15.136:0/3746518999 >> 172.21.15.136:0/3746518999 conn(0x7f92d40d0c30 msgr2=0x7f92d40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.421+0000 7f92db400640 1 -- 172.21.15.136:0/3746518999 shutdown_connections 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.421+0000 7f92db400640 1 -- 172.21.15.136:0/3746518999 wait complete. 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.422+0000 7f92db400640 1 Processor -- start 2024-05-04T07:50:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.422+0000 7f92db400640 1 -- start start 2024-05-04T07:50:24.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 0x7f92d40cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40cc110 0x7f92d40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92d415d4a0 con 0x7f92bc004800 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92d415de40 con 0x7f92d40cf9a0 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.423+0000 7f92db400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92d415e2d0 con 0x7f92d40cc110 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46666/0 (socket says 172.21.15.136:46666) 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 -- 172.21.15.136:0/176936346 learned_addr learned my addr 172.21.15.136:0/176936346 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d3e00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 0x7f92d40cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d9400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40cc110 0x7f92d40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 -- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40cc110 msgr2=0x7f92d40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40cc110 0x7f92d40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 -- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 msgr2=0x7f92d40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 0x7f92d40cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 -- 172.21.15.136:0/176936346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d415b260 con 0x7f92bc004800 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d3e00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 0x7f92d40cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.424+0000 7f92d8a00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92c800e7f0 tx=0x7f92c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.425+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c800c870 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.425+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c8018070 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.425+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c800cc10 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.425+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d40b59f0 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.425+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d40b5fb0 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.426+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d40ccad0 con 0x7f92bc004800 2024-05-04T07:50:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.427+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f92c8013420 con 0x7f92bc004800 2024-05-04T07:50:24.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.428+0000 7f92d0c00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 0x7f92b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.428+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f92c8096dc0 con 0x7f92bc004800 2024-05-04T07:50:24.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.428+0000 7f92d3e00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 0x7f92b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.429+0000 7f92d3e00640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 0x7f92b40787c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92bc004780 tx=0x7f92c0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.433+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92c8060a70 con 0x7f92bc004800 2024-05-04T07:50:24.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.625+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f92d415b430 con 0x7f92bc004800 2024-05-04T07:50:24.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.626+0000 7f92d0c00640 1 -- 172.21.15.136:0/176936346 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f92c8060370 con 0x7f92bc004800 2024-05-04T07:50:24.627 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:24.627 INFO:teuthology.orchestra.run.smithi136.stdout:[ 2024-05-04T07:50:24.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:50:24.627 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 1, 2024-05-04T07:50:24.628 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": ".mgr" 2024-05-04T07:50:24.628 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:50:24.628 INFO:teuthology.orchestra.run.smithi136.stdout:] 2024-05-04T07:50:24.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 msgr2=0x7f92b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 0x7f92b40787c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92bc004780 tx=0x7f92c0030000 comp rx=0 tx=0).stop 2024-05-04T07:50:24.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 msgr2=0x7f92d415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92c800e7f0 tx=0x7f92c800ecb0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 shutdown_connections 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f92b4076300 0x7f92b40787c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92d40cc110 0x7f92d40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92d40cf9a0 0x7f92d40cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 --2- 172.21.15.136:0/176936346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc004800 0x7f92d415a790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 >> 172.21.15.136:0/176936346 conn(0x7f92d40d0c30 msgr2=0x7f92d40c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 shutdown_connections 2024-05-04T07:50:24.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.628+0000 7f92db400640 1 -- 172.21.15.136:0/176936346 wait complete. 2024-05-04T07:50:24.647 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-04T07:50:24.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-04T07:50:24.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.842+0000 7f3ea2a00640 1 Processor -- start 2024-05-04T07:50:24.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.842+0000 7f3ea2a00640 1 -- start start 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9c162f50 con 0x7f3e9c06dd70 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9c15fb00 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c15fde0 con 0x7f3e9c06f980 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46670/0 (socket says 172.21.15.136:46670) 2024-05-04T07:50:24.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 -- 172.21.15.136:0/4057402144 learned_addr learned my addr 172.21.15.136:0/4057402144 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea0c00640 1 --1- 172.21.15.136:0/4057402144 >> v1:172.21.15.136:6789/0 conn(0x7f3e9c06dd70 0x7f3e9c06e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55296/0 (socket says 172.21.15.136:55296) 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea2000640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 -- 172.21.15.136:0/4057402144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 msgr2=0x7f3e9c0cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.844+0000 7f3ea1600640 1 -- 172.21.15.136:0/4057402144 >> v1:172.21.15.136:6789/0 conn(0x7f3e9c06dd70 legacy=0x7f3e9c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.845+0000 7f3ea1600640 1 -- 172.21.15.136:0/4057402144 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1600c0 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.845+0000 7f3ea2000640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:24.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.845+0000 7f3e9be00640 1 -- 172.21.15.136:0/4057402144 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905351238 0 0) 0x7f3e9c162f50 con 0x7f3e9c06dd70 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.846+0000 7f3ea1600640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f66e5aabb47537b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.846+0000 7f3e9be00640 1 -- 172.21.15.136:0/4057402144 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90037070 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.846+0000 7f3e9be00640 1 -- 172.21.15.136:0/4057402144 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e90032440 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.846+0000 7f3e9be00640 1 -- 172.21.15.136:0/4057402144 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90032810 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 -- 172.21.15.136:0/4057402144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 msgr2=0x7f3e9c0ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009870 tx=0x7f3e9002a1c0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 -- 172.21.15.136:0/4057402144 shutdown_connections 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/4057402144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c0ce930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 -- 172.21.15.136:0/4057402144 >> 172.21.15.136:0/4057402144 conn(0x7f3e9c0d0ac0 msgr2=0x7f3e9c0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 -- 172.21.15.136:0/4057402144 shutdown_connections 2024-05-04T07:50:24.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.847+0000 7f3ea2a00640 1 -- 172.21.15.136:0/4057402144 wait complete. 2024-05-04T07:50:24.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.849+0000 7f3ea2a00640 1 Processor -- start 2024-05-04T07:50:24.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.849+0000 7f3ea2a00640 1 -- start start 2024-05-04T07:50:24.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c06dd70 0x7f3e9c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1605e0 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c0cf540 con 0x7f3e9c06dd70 2024-05-04T07:50:24.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c155770 con 0x7f3e9c06f980 2024-05-04T07:50:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46676/0 (socket says 172.21.15.136:46676) 2024-05-04T07:50:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.850+0000 7f3ea2000640 1 -- 172.21.15.136:0/5801111 learned_addr learned my addr 172.21.15.136:0/5801111 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:24.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea1600640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c06dd70 0x7f3e9c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 -- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 msgr2=0x7f3e9c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea0c00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 -- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c06dd70 msgr2=0x7f3e9c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c06dd70 0x7f3e9c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 -- 172.21.15.136:0/5801111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1e8c50 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2000640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cef0 tx=0x7f3e9400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9401a070 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9400d860 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9400dc50 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.851+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1e8f30 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.852+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1e94f0 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.853+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c0ce670 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.854+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3e9401d070 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.855+0000 7f3e99600640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 0x7f3e7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.855+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3e94097b80 con 0x7f3e9c15f3f0 2024-05-04T07:50:24.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.855+0000 7f3ea1600640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 0x7f3e7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:24.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.856+0000 7f3ea1600640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 0x7f3e7c078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e90034000 tx=0x7f3e9002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:24.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:24.859+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3e9c0ce670 con 0x7f3e9c15f3f0 2024-05-04T07:50:25.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.066+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3e9c0b6a40 con 0x7f3e9c15f3f0 2024-05-04T07:50:25.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.460+0000 7f3e99600640 1 -- 172.21.15.136:0/5801111 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f3e940618e0 con 0x7f3e9c15f3f0 2024-05-04T07:50:25.462 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' created 2024-05-04T07:50:25.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 msgr2=0x7f3e7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 0x7f3e7c078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e90034000 tx=0x7f3e9002e000 comp rx=0 tx=0).stop 2024-05-04T07:50:25.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 msgr2=0x7f3e9c15dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400cef0 tx=0x7f3e9400a710 comp rx=0 tx=0).stop 2024-05-04T07:50:25.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 shutdown_connections 2024-05-04T07:50:25.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.464+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3e7c0762d0 0x7f3e7c078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9c15f3f0 0x7f3e9c15dad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e9c06f980 0x7f3e9c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 --2- 172.21.15.136:0/5801111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e9c06dd70 0x7f3e9c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 >> 172.21.15.136:0/5801111 conn(0x7f3e9c0d0ac0 msgr2=0x7f3e9c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:25.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 shutdown_connections 2024-05-04T07:50:25.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.465+0000 7f3ea2a00640 1 -- 172.21.15.136:0/5801111 wait complete. 2024-05-04T07:50:25.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-04T07:50:25.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.692+0000 7f6cb4400640 1 Processor -- start 2024-05-04T07:50:25.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.693+0000 7f6cb4400640 1 -- start start 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac15f3e0 0x7f6cac06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb4400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb4400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cac0718e0 con 0x7f6cac071450 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb4400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac162e00 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac1630e0 con 0x7f6cac15f3e0 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb2400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb2400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46682/0 (socket says 172.21.15.136:46682) 2024-05-04T07:50:25.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb2400640 1 -- 172.21.15.136:0/562041452 learned_addr learned my addr 172.21.15.136:0/562041452 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:25.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.694+0000 7f6cb1000640 1 --1- 172.21.15.136:0/562041452 >> v1:172.21.15.136:6789/0 conn(0x7f6cac071450 0x7f6cac072fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55310/0 (socket says 172.21.15.136:55310) 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cb1a00640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac15f3e0 0x7f6cac06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cb2400640 1 -- 172.21.15.136:0/562041452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac15f3e0 msgr2=0x7f6cac06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cb2400640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac15f3e0 0x7f6cac06c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cb2400640 1 -- 172.21.15.136:0/562041452 >> v1:172.21.15.136:6789/0 conn(0x7f6cac071450 legacy=0x7f6cac072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cb2400640 1 -- 172.21.15.136:0/562041452 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac1633c0 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.695+0000 7f6cabe00640 1 -- 172.21.15.136:0/562041452 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388866699 0 0) 0x7f6cac0718e0 con 0x7f6cac071450 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.696+0000 7f6cb2400640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009870 tx=0x7f6ca402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8cd31946bcd8d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:25.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.696+0000 7f6cabe00640 1 -- 172.21.15.136:0/562041452 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4037070 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.696+0000 7f6cabe00640 1 -- 172.21.15.136:0/562041452 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca4032440 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.696+0000 7f6cabe00640 1 -- 172.21.15.136:0/562041452 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4032810 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 -- 172.21.15.136:0/562041452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac0ccdf0 msgr2=0x7f6cac06c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009870 tx=0x7f6ca402a270 comp rx=0 tx=0).stop 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 -- 172.21.15.136:0/562041452 shutdown_connections 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac0ccdf0 0x7f6cac06c8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 --2- 172.21.15.136:0/562041452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac15f3e0 0x7f6cac06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 -- 172.21.15.136:0/562041452 >> 172.21.15.136:0/562041452 conn(0x7f6cac0d1d70 msgr2=0x7f6cac0d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 -- 172.21.15.136:0/562041452 shutdown_connections 2024-05-04T07:50:25.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.697+0000 7f6cb4400640 1 -- 172.21.15.136:0/562041452 wait complete. 2024-05-04T07:50:25.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.699+0000 7f6cb4400640 1 Processor -- start 2024-05-04T07:50:25.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.699+0000 7f6cb4400640 1 -- start start 2024-05-04T07:50:25.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 0x7f6cac0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cac15f3e0 0x7f6cac070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0d0e60 con 0x7f6cac14bef0 2024-05-04T07:50:25.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac163bc0 con 0x7f6cac15f3e0 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb4400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac0d1320 con 0x7f6cac0ccdf0 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46690/0 (socket says 172.21.15.136:46690) 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.700+0000 7f6cb2400640 1 -- 172.21.15.136:0/1293977267 learned_addr learned my addr 172.21.15.136:0/1293977267 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb1000640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cac15f3e0 0x7f6cac070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb1a00640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 0x7f6cac0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 -- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 msgr2=0x7f6cac0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 0x7f6cac0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 -- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cac15f3e0 msgr2=0x7f6cac070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cac15f3e0 0x7f6cac070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:25.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 -- 172.21.15.136:0/1293977267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac15fb30 con 0x7f6cac14bef0 2024-05-04T07:50:25.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb1a00640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 0x7f6cac0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:25.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb2400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40090b0 tx=0x7f6ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:25.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4037040 con 0x7f6cac14bef0 2024-05-04T07:50:25.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca4004030 con 0x7f6cac14bef0 2024-05-04T07:50:25.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4004400 con 0x7f6cac14bef0 2024-05-04T07:50:25.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac15fe10 con 0x7f6cac14bef0 2024-05-04T07:50:25.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.701+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac06fa50 con 0x7f6cac14bef0 2024-05-04T07:50:25.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.703+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac15ffe0 con 0x7f6cac14bef0 2024-05-04T07:50:25.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.704+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ca403a070 con 0x7f6cac14bef0 2024-05-04T07:50:25.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.705+0000 7f6ca9600640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 0x7f6c8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:25.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.705+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f6ca40b7d20 con 0x7f6cac14bef0 2024-05-04T07:50:25.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.705+0000 7f6cb1a00640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 0x7f6c8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:25.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.706+0000 7f6cb1a00640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 0x7f6c8c078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c007eb0 tx=0x7f6c9c007400 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:25.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.710+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ca4041020 con 0x7f6cac14bef0 2024-05-04T07:50:25.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:25.919+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6cac069470 con 0x7f6cac14bef0 2024-05-04T07:50:26.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.478+0000 7f6ca9600640 1 -- 172.21.15.136:0/1293977267 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f6ca40817c0 con 0x7f6cac14bef0 2024-05-04T07:50:26.479 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' created 2024-05-04T07:50:26.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.484+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 msgr2=0x7f6c8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.484+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 0x7f6c8c078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c007eb0 tx=0x7f6c9c007400 comp rx=0 tx=0).stop 2024-05-04T07:50:26.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.484+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 msgr2=0x7f6cac14c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.484+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40090b0 tx=0x7f6ca40046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 shutdown_connections 2024-05-04T07:50:26.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6c8c0762d0 0x7f6c8c078790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cac14bef0 0x7f6cac14c370 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cac15f3e0 0x7f6cac070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 --2- 172.21.15.136:0/1293977267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6cac0ccdf0 0x7f6cac0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 >> 172.21.15.136:0/1293977267 conn(0x7f6cac0d1d70 msgr2=0x7f6cac0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:26.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 shutdown_connections 2024-05-04T07:50:26.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.485+0000 7f6cb4400640 1 -- 172.21.15.136:0/1293977267 wait complete. 2024-05-04T07:50:26.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-04T07:50:26.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.694+0000 7fc277600640 1 Processor -- start 2024-05-04T07:50:26.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.695+0000 7fc277600640 1 -- start start 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc277600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc2700cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc277600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2700cc090 con 0x7fc27015f2d0 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc277600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2700d0240 con 0x7fc2700720b0 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc277600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc2700cbb10 con 0x7fc270163540 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc274c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc27015f2d0 0x7fc270162e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55326/0 (socket says 172.21.15.136:55326) 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.696+0000 7fc274c00640 1 -- 172.21.15.136:0/794075924 learned_addr learned my addr 172.21.15.136:0/794075924 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:26.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc267e00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc2700cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166059173 0 0) 0x7fc2700cc090 con 0x7fc27015f2d0 2024-05-04T07:50:26.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc254003520 con 0x7fc27015f2d0 2024-05-04T07:50:26.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3311034698 0 0) 0x7fc254003520 con 0x7fc27015f2d0 2024-05-04T07:50:26.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 msgr2=0x7fc2700cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:26.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc2700cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 >> v1:172.21.15.142:6789/0 conn(0x7fc2700720b0 legacy=0x7fc2700af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2700d0520 con 0x7fc27015f2d0 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fc2600016f0 con 0x7fc27015f2d0 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 >> v1:172.21.15.136:6789/0 conn(0x7fc27015f2d0 legacy=0x7fc270162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc254003a80 0x7fc254003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc254004800 0x7fc254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.697+0000 7fc26fe00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc254005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700cbb10 con 0x7fc254003a80 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc25400bb50 con 0x7fc254004800 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc25400bd50 con 0x7fc270163540 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc254003a80 0x7fc254003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc267e00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc254004800 0x7fc254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc275600640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc254005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 -- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 msgr2=0x7fc254005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:26.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc270163540 0x7fc254005270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 -- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc254004800 msgr2=0x7fc254004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:26.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc254004800 0x7fc254004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.698+0000 7fc274c00640 1 -- 172.21.15.136:0/794075924 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc254003520 con 0x7fc254003a80 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.699+0000 7fc274c00640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc254003a80 0x7fc254003ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c240 tx=0x7fc254005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147047b0dd24a2c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007d60 con 0x7fc254003a80 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc260005ad0 con 0x7fc254003a80 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc26fe00640 1 -- 172.21.15.136:0/794075924 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260007070 con 0x7fc254003a80 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc277600640 1 -- 172.21.15.136:0/794075924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc254003a80 msgr2=0x7fc254003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc277600640 1 --2- 172.21.15.136:0/794075924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc254003a80 0x7fc254003ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c240 tx=0x7fc254005830 comp rx=0 tx=0).stop 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc275600640 1 -- 172.21.15.136:0/794075924 reap_dead start 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc277600640 1 -- 172.21.15.136:0/794075924 shutdown_connections 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc277600640 1 -- 172.21.15.136:0/794075924 >> 172.21.15.136:0/794075924 conn(0x7fc2700d0c50 msgr2=0x7fc2700d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.700+0000 7fc277600640 1 -- 172.21.15.136:0/794075924 shutdown_connections 2024-05-04T07:50:26.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.701+0000 7fc277600640 1 -- 172.21.15.136:0/794075924 wait complete. 2024-05-04T07:50:26.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.702+0000 7fc277600640 1 Processor -- start 2024-05-04T07:50:26.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.702+0000 7fc277600640 1 -- start start 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254003a80 0x7fc270156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 0x7fc27015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc270163b30 con 0x7fc2700b4c30 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700cc370 con 0x7fc2700b50b0 2024-05-04T07:50:26.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.703+0000 7fc277600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc2700c4d90 con 0x7fc254003a80 2024-05-04T07:50:26.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46722/0 (socket says 172.21.15.136:46722) 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 -- 172.21.15.136:0/3848781202 learned_addr learned my addr 172.21.15.136:0/3848781202 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc275600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 0x7fc27015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc274c00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254003a80 0x7fc270156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 -- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254003a80 msgr2=0x7fc270156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254003a80 0x7fc270156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 -- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 msgr2=0x7fc27015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 0x7fc27015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc267e00640 1 -- 172.21.15.136:0/3848781202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2700b5680 con 0x7fc2700b4c30 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.704+0000 7fc275600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 0x7fc27015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc267e00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc258011660 tx=0x7fc258011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25800f9c0 con 0x7fc2700b4c30 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25800fb60 con 0x7fc2700b4c30 2024-05-04T07:50:26.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258015460 con 0x7fc2700b4c30 2024-05-04T07:50:26.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2700b5960 con 0x7fc2700b4c30 2024-05-04T07:50:26.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.705+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2700c52a0 con 0x7fc2700b4c30 2024-05-04T07:50:26.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.706+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc270069470 con 0x7fc2700b4c30 2024-05-04T07:50:26.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.708+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc258015600 con 0x7fc2700b4c30 2024-05-04T07:50:26.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.708+0000 7fc26d600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 0x7fc24c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:26.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.709+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fc258097d00 con 0x7fc2700b4c30 2024-05-04T07:50:26.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.709+0000 7fc274c00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 0x7fc24c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:26.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.709+0000 7fc274c00640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 0x7fc24c078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c240 tx=0x7fc260009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:26.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.712+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc258019030 con 0x7fc2700b4c30 2024-05-04T07:50:26.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:26.960+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc2700cea60 con 0x7fc2700b4c30 2024-05-04T07:50:27.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.482+0000 7fc26d600640 1 -- 172.21.15.136:0/3848781202 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc2580617a0 con 0x7fc2700b4c30 2024-05-04T07:50:27.483 INFO:teuthology.orchestra.run.smithi136.stderr:new fs with metadata pool 2 and data pool 3 2024-05-04T07:50:27.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 msgr2=0x7fc24c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 0x7fc24c078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c240 tx=0x7fc260009030 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 msgr2=0x7fc27015c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc258011660 tx=0x7fc258011b20 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 shutdown_connections 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc24c076350 0x7fc24c078810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2700b50b0 0x7fc27015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2700b4c30 0x7fc27015c4e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 --2- 172.21.15.136:0/3848781202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc254003a80 0x7fc270156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 >> 172.21.15.136:0/3848781202 conn(0x7fc2700d0c50 msgr2=0x7fc2700af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:27.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 shutdown_connections 2024-05-04T07:50:27.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.487+0000 7fc277600640 1 -- 172.21.15.136:0/3848781202 wait complete. 2024-05-04T07:50:27.528 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-04T07:50:27.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-04T07:50:27.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.703+0000 7f9dc6e00640 1 Processor -- start 2024-05-04T07:50:27.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.703+0000 7f9dc6e00640 1 -- start start 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.704+0000 7f9dc6e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dc015d170 0x7f9dc0073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.704+0000 7f9dc6e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc0074150 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.704+0000 7f9dc6e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc0160b90 con 0x7f9dc015cd90 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.704+0000 7f9dc6e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc01614c0 con 0x7f9dc015d170 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbf400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9dc00cd1e0 0x7f9dc006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55330/0 (socket says 172.21.15.136:55330) 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbf400640 1 -- 172.21.15.136:0/3832795517 learned_addr learned my addr 172.21.15.136:0/3832795517 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:27.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dc4e00640 1 --2- 172.21.15.136:0/3832795517 >> v2:172.21.15.142:3300/0 conn(0x7f9dc015d170 0x7f9dc0073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248363506 0 0) 0x7f9dc0074150 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9da4003520 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1189442627 0 0) 0x7f9da4003520 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 >> v2:172.21.15.142:3300/0 conn(0x7f9dc015d170 msgr2=0x7f9dc0073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 --2- 172.21.15.136:0/3832795517 >> v2:172.21.15.142:3300/0 conn(0x7f9dc015d170 0x7f9dc0073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 >> v1:172.21.15.142:6789/0 conn(0x7f9dc015cd90 legacy=0x7f9dc00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc0160e70 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f9dac0016f0 con 0x7f9dc00cd1e0 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 >> v1:172.21.15.136:6789/0 conn(0x7f9dc00cd1e0 legacy=0x7f9dc006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da4003a50 0x7f9da4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.705+0000 7f9dbea00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9da4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbea00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da4005210 0x7f9da400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01614c0 con 0x7f9da4004800 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9da400c140 con 0x7f9da4005210 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9da400c340 con 0x7f9da4003a50 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9da4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbfe00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da4003a50 0x7f9da4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 -- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da4003a50 msgr2=0x7f9da4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da4003a50 0x7f9da4003e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 -- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da4005210 msgr2=0x7f9da400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dc4e00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da4005210 0x7f9da400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da4005210 0x7f9da400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dc4e00640 1 -- 172.21.15.136:0/3832795517 reap_dead start 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.706+0000 7f9dbf400640 1 -- 172.21.15.136:0/3832795517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da4003520 con 0x7f9da4004800 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.707+0000 7f9dbf400640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9da4004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00c240 tx=0x7f9da4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ee3369db2a8333 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.707+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007d70 con 0x7f9da4004800 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.707+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dac005ad0 con 0x7f9da4004800 2024-05-04T07:50:27.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.707+0000 7f9dbea00640 1 -- 172.21.15.136:0/3832795517 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007070 con 0x7f9da4004800 2024-05-04T07:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 -- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 msgr2=0x7f9da4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9da4004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dac00c240 tx=0x7f9da4005830 comp rx=0 tx=0).stop 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 -- 172.21.15.136:0/3832795517 shutdown_connections 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/3832795517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9da4004c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 -- 172.21.15.136:0/3832795517 >> 172.21.15.136:0/3832795517 conn(0x7f9dc00d0bf0 msgr2=0x7f9dc00d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 -- 172.21.15.136:0/3832795517 shutdown_connections 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.708+0000 7f9dc6e00640 1 -- 172.21.15.136:0/3832795517 wait complete. 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.710+0000 7f9dc6e00640 1 Processor -- start 2024-05-04T07:50:27.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.710+0000 7f9dc6e00640 1 -- start start 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc01496e0 0x7f9dc0157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc01561c0 0x7f9dc00cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0161950 con 0x7f9da4004800 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0073a70 con 0x7f9dc01496e0 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dc6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc0156ba0 con 0x7f9dc01561c0 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46736/0 (socket says 172.21.15.136:46736) 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 -- 172.21.15.136:0/421731687 learned_addr learned my addr 172.21.15.136:0/421731687 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 -- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc01561c0 msgr2=0x7f9dc00cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc01561c0 0x7f9dc00cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 -- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc01496e0 msgr2=0x7f9dc0157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbf400640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc01496e0 0x7f9dc0157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc01496e0 0x7f9dc0157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.711+0000 7f9dbfe00640 1 -- 172.21.15.136:0/421731687 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc0156e80 con 0x7f9da4004800 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9dbfe00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d520 tx=0x7f9db000d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0005480 con 0x7f9da4004800 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db0017070 con 0x7f9da4004800 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc0157160 con 0x7f9da4004800 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003850 con 0x7f9da4004800 2024-05-04T07:50:27.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.712+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc0157720 con 0x7f9da4004800 2024-05-04T07:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.713+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc00694e0 con 0x7f9da4004800 2024-05-04T07:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.714+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9db00039f0 con 0x7f9da4004800 2024-05-04T07:50:27.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.715+0000 7f9db7e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 0x7f9da0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:27.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.715+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f9db0097450 con 0x7f9da4004800 2024-05-04T07:50:27.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.715+0000 7f9dbf400640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 0x7f9da0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:27.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.716+0000 7f9dbf400640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 0x7f9da0078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9dac032000 tx=0x7f9dac009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:27.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.720+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9db0060d10 con 0x7f9da4004800 2024-05-04T07:50:27.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:27.929+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9dc006fc30 con 0x7f9da4004800 2024-05-04T07:50:28.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.510+0000 7f9db7e00640 1 -- 172.21.15.136:0/421731687 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f9db0060610 con 0x7f9da4004800 2024-05-04T07:50:28.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.515+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 msgr2=0x7f9da0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.515+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 0x7f9da0078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9dac032000 tx=0x7f9dac009030 comp rx=0 tx=0).stop 2024-05-04T07:50:28.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 msgr2=0x7f9dc0154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d520 tx=0x7f9db000d9e0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 shutdown_connections 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9da00762d0 0x7f9da0078790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9dc01561c0 0x7f9dc00cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dc01496e0 0x7f9dc0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 --2- 172.21.15.136:0/421731687 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9da4004800 0x7f9dc0154930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.516+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 >> 172.21.15.136:0/421731687 conn(0x7f9dc00d0bf0 msgr2=0x7f9dc00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:28.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.517+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 shutdown_connections 2024-05-04T07:50:28.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.517+0000 7f9dc6e00640 1 -- 172.21.15.136:0/421731687 wait complete. 2024-05-04T07:50:28.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-04T07:50:28.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.743+0000 7fe065000640 1 Processor -- start 2024-05-04T07:50:28.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.743+0000 7fe065000640 1 -- start start 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe065000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe06015f300 0x7fe0600d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe065000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0600d09f0 0x7fe0600d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe065000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0600b7ed0 con 0x7fe0600d3950 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe065000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe0600d3dc0 con 0x7fe0600d09f0 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe065000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe06015f6e0 con 0x7fe06015f300 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0600d09f0 0x7fe0600d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0600d09f0 0x7fe0600d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46748/0 (socket says 172.21.15.136:46748) 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 -- 172.21.15.136:0/3572129766 learned_addr learned my addr 172.21.15.136:0/3572129766 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05f400640 1 --2- 172.21.15.136:0/3572129766 >> v2:172.21.15.142:3300/0 conn(0x7fe06015f300 0x7fe0600d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 -- 172.21.15.136:0/3572129766 >> v2:172.21.15.142:3300/0 conn(0x7fe06015f300 msgr2=0x7fe0600d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:28.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 --2- 172.21.15.136:0/3572129766 >> v2:172.21.15.142:3300/0 conn(0x7fe06015f300 0x7fe0600d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 -- 172.21.15.136:0/3572129766 >> v1:172.21.15.136:6789/0 conn(0x7fe0600d3950 legacy=0x7fe0600b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.745+0000 7fe05ea00640 1 -- 172.21.15.136:0/3572129766 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0600b81b0 con 0x7fe0600d09f0 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.746+0000 7fe05ea00640 1 --2- 172.21.15.136:0/3572129766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0600d09f0 0x7fe0600d3410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0600b79f0 tx=0x7fe04c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d32d18d31ecbd7a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.747+0000 7fe05e000640 1 -- 172.21.15.136:0/3572129766 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c037070 con 0x7fe0600d09f0 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.747+0000 7fe05e000640 1 -- 172.21.15.136:0/3572129766 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c032440 con 0x7fe0600d09f0 2024-05-04T07:50:28.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.747+0000 7fe05e000640 1 -- 172.21.15.136:0/3572129766 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c032810 con 0x7fe0600d09f0 2024-05-04T07:50:28.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.747+0000 7fe065000640 1 -- 172.21.15.136:0/3572129766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0600d09f0 msgr2=0x7fe0600d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.747+0000 7fe065000640 1 --2- 172.21.15.136:0/3572129766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0600d09f0 0x7fe0600d3410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0600b79f0 tx=0x7fe04c02a270 comp rx=0 tx=0).stop 2024-05-04T07:50:28.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 -- 172.21.15.136:0/3572129766 shutdown_connections 2024-05-04T07:50:28.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 --2- 172.21.15.136:0/3572129766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0600d09f0 0x7fe0600d3410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 --2- 172.21.15.136:0/3572129766 >> v2:172.21.15.142:3300/0 conn(0x7fe06015f300 0x7fe0600d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 -- 172.21.15.136:0/3572129766 >> 172.21.15.136:0/3572129766 conn(0x7fe0600d4e30 msgr2=0x7fe0600d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:28.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 -- 172.21.15.136:0/3572129766 shutdown_connections 2024-05-04T07:50:28.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.748+0000 7fe065000640 1 -- 172.21.15.136:0/3572129766 wait complete. 2024-05-04T07:50:28.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.749+0000 7fe065000640 1 Processor -- start 2024-05-04T07:50:28.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.750+0000 7fe065000640 1 -- start start 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.750+0000 7fe065000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0600d09f0 0x7fe06009f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.750+0000 7fe065000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0600d3950 0x7fe060160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.750+0000 7fe065000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe065000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600b8770 con 0x7fe06015f300 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe065000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600b7c80 con 0x7fe0600d3950 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe065000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe0600b8a50 con 0x7fe0600d09f0 2024-05-04T07:50:28.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46756/0 (socket says 172.21.15.136:46756) 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 -- 172.21.15.136:0/964735790 learned_addr learned my addr 172.21.15.136:0/964735790 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05f400640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0600d09f0 0x7fe06009f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05ea00640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0600d3950 0x7fe060160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 -- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0600d09f0 msgr2=0x7fe06009f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0600d09f0 0x7fe06009f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 -- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0600d3950 msgr2=0x7fe060160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0600d3950 0x7fe060160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 -- 172.21.15.136:0/964735790 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0601614b0 con 0x7fe06015f300 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.751+0000 7fe05fe00640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c7d0 tx=0x7fe05800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.752+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058003b70 con 0x7fe06015f300 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.752+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe058003d30 con 0x7fe06015f300 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.752+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0600a1190 con 0x7fe06015f300 2024-05-04T07:50:28.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.752+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05800aa90 con 0x7fe06015f300 2024-05-04T07:50:28.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.752+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06009f060 con 0x7fe06015f300 2024-05-04T07:50:28.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.753+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe060069400 con 0x7fe06015f300 2024-05-04T07:50:28.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.754+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe05800ac30 con 0x7fe06015f300 2024-05-04T07:50:28.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.755+0000 7fe057400640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 0x7fe040078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:28.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.755+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fe058097630 con 0x7fe06015f300 2024-05-04T07:50:28.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.755+0000 7fe05f400640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 0x7fe040078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:28.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.756+0000 7fe05f400640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 0x7fe040078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0600cb130 tx=0x7fe050008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:28.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.760+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe058060e60 con 0x7fe06015f300 2024-05-04T07:50:28.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:28.949+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe0600cbc70 con 0x7fe06015f300 2024-05-04T07:50:30.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.519+0000 7fe057400640 1 -- 172.21.15.136:0/964735790 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fe058060760 con 0x7fe06015f300 2024-05-04T07:50:30.520 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' created 2024-05-04T07:50:30.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 msgr2=0x7fe040078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 0x7fe040078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe0600cb130 tx=0x7fe050008040 comp rx=0 tx=0).stop 2024-05-04T07:50:30.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 msgr2=0x7fe0600a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c7d0 tx=0x7fe05800cc90 comp rx=0 tx=0).stop 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 shutdown_connections 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0400762d0 0x7fe040078790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe06015f300 0x7fe0600a0710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0600d3950 0x7fe060160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 --2- 172.21.15.136:0/964735790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0600d09f0 0x7fe06009f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 >> 172.21.15.136:0/964735790 conn(0x7fe0600d4e30 msgr2=0x7fe06006d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:30.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.523+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 shutdown_connections 2024-05-04T07:50:30.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.524+0000 7fe065000640 1 -- 172.21.15.136:0/964735790 wait complete. 2024-05-04T07:50:30.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-04T07:50:30.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.732+0000 7f16e9800640 1 Processor -- start 2024-05-04T07:50:30.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.732+0000 7f16e9800640 1 -- start start 2024-05-04T07:50:30.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e9800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f16e40b6010 0x7f16e40d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e9800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e40b7eb0 con 0x7f16e4162a10 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e9800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e40d06b0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e9800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f16e40d0930 con 0x7f16e40b6010 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e3400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f16e40b6010 0x7f16e40d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e3400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f16e40b6010 0x7f16e40d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46772/0 (socket says 172.21.15.136:46772) 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.734+0000 7f16e3400640 1 -- 172.21.15.136:0/1502278099 learned_addr learned my addr 172.21.15.136:0/1502278099 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:30.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.735+0000 7f16e3400640 1 -- 172.21.15.136:0/1502278099 >> v1:172.21.15.142:6789/0 conn(0x7f16e40d3cb0 legacy=0x7f16e40b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.735+0000 7f16e3400640 1 -- 172.21.15.136:0/1502278099 >> v1:172.21.15.136:6789/0 conn(0x7f16e4162a10 legacy=0x7f16e40d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.735+0000 7f16e3400640 1 -- 172.21.15.136:0/1502278099 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e40d0c10 con 0x7f16e40b6010 2024-05-04T07:50:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e3400640 1 --2- 172.21.15.136:0/1502278099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40b6010 0x7f16e40d2da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009e50 tx=0x7f16dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf698da6599d0a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e2000640 1 -- 172.21.15.136:0/1502278099 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc036070 con 0x7f16e40b6010 2024-05-04T07:50:30.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e2000640 1 -- 172.21.15.136:0/1502278099 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16dc031600 con 0x7f16e40b6010 2024-05-04T07:50:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e2000640 1 -- 172.21.15.136:0/1502278099 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0319d0 con 0x7f16e40b6010 2024-05-04T07:50:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e9800640 1 -- 172.21.15.136:0/1502278099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40b6010 msgr2=0x7f16e40d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.736+0000 7f16e9800640 1 --2- 172.21.15.136:0/1502278099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40b6010 0x7f16e40d2da0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009e50 tx=0x7f16dc02a710 comp rx=0 tx=0).stop 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.737+0000 7f16e9800640 1 -- 172.21.15.136:0/1502278099 shutdown_connections 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.737+0000 7f16e9800640 1 --2- 172.21.15.136:0/1502278099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40b6010 0x7f16e40d2da0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.737+0000 7f16e9800640 1 -- 172.21.15.136:0/1502278099 >> 172.21.15.136:0/1502278099 conn(0x7f16e40d4fc0 msgr2=0x7f16e40d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.737+0000 7f16e9800640 1 -- 172.21.15.136:0/1502278099 shutdown_connections 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.737+0000 7f16e9800640 1 -- 172.21.15.136:0/1502278099 wait complete. 2024-05-04T07:50:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.738+0000 7f16e9800640 1 Processor -- start 2024-05-04T07:50:30.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.738+0000 7f16e9800640 1 -- start start 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16e40b6010 0x7f16e415f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16e4162a10 0x7f16e40a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4162df0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f16e40d0ef0 con 0x7f16e4162a10 2024-05-04T07:50:30.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.739+0000 7f16e9800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f16e40b8d50 con 0x7f16e40b6010 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46780/0 (socket says 172.21.15.136:46780) 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 -- 172.21.15.136:0/3243186460 learned_addr learned my addr 172.21.15.136:0/3243186460 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16e2a00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16e40b6010 0x7f16e415f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 -- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16e40b6010 msgr2=0x7f16e415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16e3400640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16e4162a10 0x7f16e40a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16e40b6010 0x7f16e415f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 -- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16e4162a10 msgr2=0x7f16e40a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16e4162a10 0x7f16e40a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 -- 172.21.15.136:0/3243186460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e40a2bc0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.740+0000 7f16dbe00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c430 tx=0x7f16cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.741+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011790 con 0x7f16e40d3cb0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.741+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16cc017070 con 0x7f16e40d3cb0 2024-05-04T07:50:30.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.741+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc011b70 con 0x7f16e40d3cb0 2024-05-04T07:50:30.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.741+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e41f85c0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.741+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41f8b80 con 0x7f16e40d3cb0 2024-05-04T07:50:30.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.742+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e40694e0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.743+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f16cc011d10 con 0x7f16e40d3cb0 2024-05-04T07:50:30.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.744+0000 7f16daa00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 0x7f16c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:30.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.744+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f16cc097760 con 0x7f16e40d3cb0 2024-05-04T07:50:30.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.744+0000 7f16e2a00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 0x7f16c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:30.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.745+0000 7f16e2a00640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 0x7f16c0078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16d40015a0 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:30.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.749+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16e40a2bc0 con 0x7f16e40d3cb0 2024-05-04T07:50:30.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:30.955+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f16e4161600 con 0x7f16e40d3cb0 2024-05-04T07:50:31.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.523+0000 7f16daa00640 1 -- 172.21.15.136:0/3243186460 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f16cc060d90 con 0x7f16e40d3cb0 2024-05-04T07:50:31.524 INFO:teuthology.orchestra.run.smithi136.stderr:set pool 4 allow_ec_overwrites to true 2024-05-04T07:50:31.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.527+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 msgr2=0x7f16c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.527+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 0x7f16c0078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f16d40015a0 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2024-05-04T07:50:31.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.527+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 msgr2=0x7f16e40a2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.527+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c430 tx=0x7f16cc00c8f0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 shutdown_connections 2024-05-04T07:50:31.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16c00762d0 0x7f16c0078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16e4162a10 0x7f16e40a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16e40d3cb0 0x7f16e40a2680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 --2- 172.21.15.136:0/3243186460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16e40b6010 0x7f16e415f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.528+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 >> 172.21.15.136:0/3243186460 conn(0x7f16e40d4fc0 msgr2=0x7f16e40b8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:31.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.530+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 shutdown_connections 2024-05-04T07:50:31.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.531+0000 7f16e9800640 1 -- 172.21.15.136:0/3243186460 wait complete. 2024-05-04T07:50:31.574 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-04T07:50:31.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.745+0000 7f2fc8e00640 1 Processor -- start 2024-05-04T07:50:31.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.745+0000 7f2fc8e00640 1 -- start start 2024-05-04T07:50:31.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.747+0000 7f2fc8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc4071ed0 0x7f2fc40cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.747+0000 7f2fc8e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2fc40ce820 0x7f2fc40722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc8e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc40727f0 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc8e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc40c45c0 con 0x7f2fc40ce820 2024-05-04T07:50:31.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc40ced70 con 0x7f2fc4071ed0 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc2800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2fc40cb7b0 0x7f2fc406dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55356/0 (socket says 172.21.15.136:55356) 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc2800640 1 -- 172.21.15.136:0/1587771112 learned_addr learned my addr 172.21.15.136:0/1587771112 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.748+0000 7f2fc1400640 1 --2- 172.21.15.136:0/1587771112 >> v2:172.21.15.136:3300/0 conn(0x7f2fc40ce820 0x7f2fc40722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc0a00640 1 -- 172.21.15.136:0/1587771112 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147819079 0 0) 0x7f2fc40727f0 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc0a00640 1 -- 172.21.15.136:0/1587771112 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fa8003520 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc1400640 1 -- 172.21.15.136:0/1587771112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc4071ed0 msgr2=0x7f2fc40cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:31.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc1400640 1 --2- 172.21.15.136:0/1587771112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc4071ed0 0x7f2fc40cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc1400640 1 -- 172.21.15.136:0/1587771112 >> v1:172.21.15.136:6789/0 conn(0x7f2fc40cb7b0 legacy=0x7f2fc406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.749+0000 7f2fc1400640 1 -- 172.21.15.136:0/1587771112 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc40cf050 con 0x7f2fc40ce820 2024-05-04T07:50:31.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.751+0000 7f2fc1400640 1 --2- 172.21.15.136:0/1587771112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc40722b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00097a0 tx=0x7f2fb002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90679b9ec29a8ad server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:31.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.751+0000 7f2fc0a00640 1 -- 172.21.15.136:0/1587771112 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0037070 con 0x7f2fc40ce820 2024-05-04T07:50:31.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.751+0000 7f2fc0a00640 1 -- 172.21.15.136:0/1587771112 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0032440 con 0x7f2fc40ce820 2024-05-04T07:50:31.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.751+0000 7f2fc0a00640 1 -- 172.21.15.136:0/1587771112 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0032810 con 0x7f2fc40ce820 2024-05-04T07:50:31.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 -- 172.21.15.136:0/1587771112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 msgr2=0x7f2fc40722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/1587771112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc40722b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00097a0 tx=0x7f2fb002a180 comp rx=0 tx=0).stop 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 -- 172.21.15.136:0/1587771112 shutdown_connections 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/1587771112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc40722b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/1587771112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc4071ed0 0x7f2fc40cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 -- 172.21.15.136:0/1587771112 >> 172.21.15.136:0/1587771112 conn(0x7f2fc40d0c50 msgr2=0x7f2fc40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 -- 172.21.15.136:0/1587771112 shutdown_connections 2024-05-04T07:50:31.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.752+0000 7f2fc8e00640 1 -- 172.21.15.136:0/1587771112 wait complete. 2024-05-04T07:50:31.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.754+0000 7f2fc8e00640 1 Processor -- start 2024-05-04T07:50:31.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.754+0000 7f2fc8e00640 1 -- start start 2024-05-04T07:50:31.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc4071ed0 0x7f2fc4156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc406f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc40cf8f0 con 0x7f2fc40ce820 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc40cf610 con 0x7f2fc4071ed0 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.756+0000 7f2fc8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc4166e00 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.757+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.757+0000 7f2fc1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc4071ed0 0x7f2fc4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.757+0000 7f2fc1400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:44798/0 (socket says 172.21.15.136:44798) 2024-05-04T07:50:31.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.757+0000 7f2fc1400640 1 -- 172.21.15.136:0/688582805 learned_addr learned my addr 172.21.15.136:0/688582805 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.758+0000 7f2fc2800640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc406f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.758+0000 7f2fc1400640 1 -- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc4071ed0 msgr2=0x7f2fc4156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.758+0000 7f2fc1400640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc4071ed0 0x7f2fc4156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.759+0000 7f2fc1400640 1 -- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 msgr2=0x7f2fc406f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.759+0000 7f2fc1400640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc406f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:31.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.759+0000 7f2fc1400640 1 -- 172.21.15.136:0/688582805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41fc820 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.760+0000 7f2fc1400640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0000c00 tx=0x7f2fb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:31.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.761+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0037040 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.761+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0042070 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.761+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc41fcb00 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.761+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0030920 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.761+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc41fd0c0 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.762+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4069470 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.764+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fb0030ac0 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.765+0000 7f2fba000640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:31.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.765+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f2fb00b8d20 con 0x7f2fc40cb7b0 2024-05-04T07:50:31.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.765+0000 7f2fc1e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:31.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.766+0000 7f2fc1e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 0x7f2fa4078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406ed10 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:31.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:31.771+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fb0081d80 con 0x7f2fc40cb7b0 2024-05-04T07:50:32.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.011+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f2fc4163810 con 0x7f2fc40cb7b0 2024-05-04T07:50:32.446 INFO:tasks.ceph.mds.b.smithi142.stderr:2024-05-04T07:50:32.445+0000 7f3559c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-04T07:50:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.582+0000 7f2fba000640 1 -- 172.21.15.136:0/688582805 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f2fb008a3c0 con 0x7f2fc40cb7b0 2024-05-04T07:50:32.583 INFO:teuthology.orchestra.run.smithi136.stderr:added data pool 4 to fsmap 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 msgr2=0x7f2fa4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 0x7f2fa4078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406ed10 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 msgr2=0x7f2fc406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0000c00 tx=0x7f2fb00046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 shutdown_connections 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fc40ce820 0x7f2fc406f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc40cb7b0 0x7f2fc406f410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 --2- 172.21.15.136:0/688582805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc4071ed0 0x7f2fc4156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.585+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 >> 172.21.15.136:0/688582805 conn(0x7f2fc40d0c50 msgr2=0x7f2fc40722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:32.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.586+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 shutdown_connections 2024-05-04T07:50:32.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.586+0000 7f2fc8e00640 1 -- 172.21.15.136:0/688582805 wait complete. 2024-05-04T07:50:32.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:32.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.800+0000 7fdceb200640 1 Processor -- start 2024-05-04T07:50:32.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.800+0000 7fdceb200640 1 -- start start 2024-05-04T07:50:32.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdceb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec06dce0 0x7fdcec0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdceb200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdcec15f510 0x7fdcec06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdceb200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcec06e600 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdceb200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdcec0d1970 con 0x7fdcec15f510 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdceb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdcec0d1690 con 0x7fdcec06dce0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdcea800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdcec0cc9c0 0x7fdcec0ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55362/0 (socket says 172.21.15.136:55362) 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdcea800640 1 -- 172.21.15.136:0/2394732680 learned_addr learned my addr 172.21.15.136:0/2394732680 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdce9400640 1 --2- 172.21.15.136:0/2394732680 >> v2:172.21.15.142:3300/0 conn(0x7fdcec15f510 0x7fdcec06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdce9e00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec06dce0 0x7fdcec0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439410504 0 0) 0x7fdcec06e600 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.802+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd0003520 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1203439828 0 0) 0x7fdcd0003520 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec06dce0 msgr2=0x7fdcec0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec06dce0 0x7fdcec0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 >> v2:172.21.15.142:3300/0 conn(0x7fdcec15f510 msgr2=0x7fdcec06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 --2- 172.21.15.136:0/2394732680 >> v2:172.21.15.142:3300/0 conn(0x7fdcec15f510 0x7fdcec06e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec0cbd80 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fdce4001a70 con 0x7fdcec0cc9c0 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 >> v1:172.21.15.136:6789/0 conn(0x7fdcec0cc9c0 legacy=0x7fdcec0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd0003a00 0x7fdcd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0004800 0x7fdcd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec0d1690 con 0x7fdcd00051c0 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd000bf60 con 0x7fdcd0004800 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd000c160 con 0x7fdcd0003a00 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.803+0000 7fdcea800640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdce9400640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0004800 0x7fdcd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdce9e00640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd0003a00 0x7fdcd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdcea800640 1 -- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd0003a00 msgr2=0x7fdcd0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdcea800640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd0003a00 0x7fdcd0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdcea800640 1 -- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0004800 msgr2=0x7fdcd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdcea800640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd0004800 0x7fdcd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.804+0000 7fdcea800640 1 -- 172.21.15.136:0/2394732680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd0003520 con 0x7fdcd00051c0 2024-05-04T07:50:32.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.805+0000 7fdcea800640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcd000b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdce400a8a0 tx=0x7fdcd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401e56720f04a89 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:32.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.805+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce400a4c0 con 0x7fdcd00051c0 2024-05-04T07:50:32.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.805+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce402f070 con 0x7fdcd00051c0 2024-05-04T07:50:32.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.805+0000 7fdce8a00640 1 -- 172.21.15.136:0/2394732680 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce402bd30 con 0x7fdcd00051c0 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 -- 172.21.15.136:0/2394732680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 msgr2=0x7fdcd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 --2- 172.21.15.136:0/2394732680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcd000b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdce400a8a0 tx=0x7fdcd0005830 comp rx=0 tx=0).stop 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdcea800640 1 -- 172.21.15.136:0/2394732680 reap_dead start 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 -- 172.21.15.136:0/2394732680 shutdown_connections 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 -- 172.21.15.136:0/2394732680 >> 172.21.15.136:0/2394732680 conn(0x7fdcec0d09d0 msgr2=0x7fdcec0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 -- 172.21.15.136:0/2394732680 shutdown_connections 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.806+0000 7fdceb200640 1 -- 172.21.15.136:0/2394732680 wait complete. 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.808+0000 7fdceb200640 1 Processor -- start 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.808+0000 7fdceb200640 1 -- start start 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcec1f4610 0x7fdcec15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec072ca0 0x7fdcec073120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec0af890 con 0x7fdcd00051c0 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec0cc340 con 0x7fdcec1f4610 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdceb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdcec0afa10 con 0x7fdcec072ca0 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdce9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdce9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46812/0 (socket says 172.21.15.136:46812) 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.809+0000 7fdce9e00640 1 -- 172.21.15.136:0/1950549897 learned_addr learned my addr 172.21.15.136:0/1950549897 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdcea800640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec072ca0 0x7fdcec073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9400640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcec1f4610 0x7fdcec15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 -- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec072ca0 msgr2=0x7fdcec073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec072ca0 0x7fdcec073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 -- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcec1f4610 msgr2=0x7fdcec15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:32.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcec1f4610 0x7fdcec15ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 -- 172.21.15.136:0/1950549897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec15b3c0 con 0x7fdcd00051c0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce9e00640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00f530 tx=0x7fdcdc00f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc019030 con 0x7fdcd00051c0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc004020 con 0x7fdcd00051c0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcec15b6a0 con 0x7fdcd00051c0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc004410 con 0x7fdcd00051c0 2024-05-04T07:50:32.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.810+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcec15bc60 con 0x7fdcd00051c0 2024-05-04T07:50:32.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.812+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcec069400 con 0x7fdcd00051c0 2024-05-04T07:50:32.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.813+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdcdc01c070 con 0x7fdcd00051c0 2024-05-04T07:50:32.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.814+0000 7fdce2000640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 0x7fdccc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:32.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.814+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdcdc097cf0 con 0x7fdcd00051c0 2024-05-04T07:50:32.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.814+0000 7fdce9400640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 0x7fdccc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:32.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.815+0000 7fdce9400640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 0x7fdccc0787c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcec14c450 tx=0x7fdcd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:32.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:32.819+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdcdc061300 con 0x7fdcd00051c0 2024-05-04T07:50:33.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.049+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcec0b1110 con 0x7fdcd00051c0 2024-05-04T07:50:33.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.050+0000 7fdce2000640 1 -- 172.21.15.136:0/1950549897 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5186 (secure 0 0 0) 0x7fdcdc060c00 con 0x7fdcd00051c0 2024-05-04T07:50:33.051 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:33.051 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:32.014369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:33.051 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2024-05-04T07:50:33.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.052+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 msgr2=0x7fdccc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.052+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 0x7fdccc0787c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcec14c450 tx=0x7fdcd8008040 comp rx=0 tx=0).stop 2024-05-04T07:50:33.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.052+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 msgr2=0x7fdcec149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.052+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00f530 tx=0x7fdcdc00f9f0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 shutdown_connections 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdccc076300 0x7fdccc0787c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcec072ca0 0x7fdcec073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcec1f4610 0x7fdcec15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 --2- 172.21.15.136:0/1950549897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd00051c0 0x7fdcec149560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 >> 172.21.15.136:0/1950549897 conn(0x7fdcec0d09d0 msgr2=0x7fdcec0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 shutdown_connections 2024-05-04T07:50:33.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.053+0000 7fdceb200640 1 -- 172.21.15.136:0/1950549897 wait complete. 2024-05-04T07:50:33.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:33.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.253+0000 7f13c7e00640 1 Processor -- start 2024-05-04T07:50:33.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.254+0000 7f13c7e00640 1 -- start start 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13c80d3460 0x7f13c80d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c7e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c80d3d80 con 0x7f13c80b1c60 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c7e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c80b2170 con 0x7f13c80b31f0 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c7e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f13c80b2430 con 0x7f13c80d3460 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c6000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f13c80b1c60 0x7f13c80d59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55376/0 (socket says 172.21.15.136:55376) 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c6000640 1 -- 172.21.15.136:0/3607710958 learned_addr learned my addr 172.21.15.136:0/3607710958 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:33.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.255+0000 7f13c6a00640 1 --2- 172.21.15.136:0/3607710958 >> v2:172.21.15.136:3300/0 conn(0x7f13c80d3460 0x7f13c80d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.256+0000 7f13c5600640 1 -- 172.21.15.136:0/3607710958 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597967225 0 0) 0x7f13c80d3d80 con 0x7f13c80b1c60 2024-05-04T07:50:33.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.256+0000 7f13c5600640 1 -- 172.21.15.136:0/3607710958 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13ac003520 con 0x7f13c80b1c60 2024-05-04T07:50:33.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.256+0000 7f13c6a00640 1 -- 172.21.15.136:0/3607710958 >> v1:172.21.15.142:6789/0 conn(0x7f13c80b31f0 legacy=0x7f13c80b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:33.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.256+0000 7f13c6a00640 1 -- 172.21.15.136:0/3607710958 >> v1:172.21.15.136:6789/0 conn(0x7f13c80b1c60 legacy=0x7f13c80d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.256+0000 7f13c6a00640 1 -- 172.21.15.136:0/3607710958 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c80b2710 con 0x7f13c80d3460 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.257+0000 7f13c6a00640 1 --2- 172.21.15.136:0/3607710958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c80d3840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13b80097a0 tx=0x7f13b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03f95b33bff44d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.257+0000 7f13c5600640 1 -- 172.21.15.136:0/3607710958 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8037070 con 0x7f13c80d3460 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.257+0000 7f13c5600640 1 -- 172.21.15.136:0/3607710958 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b802ae50 con 0x7f13c80d3460 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.257+0000 7f13c5600640 1 -- 172.21.15.136:0/3607710958 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8032660 con 0x7f13c80d3460 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 -- 172.21.15.136:0/3607710958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 msgr2=0x7f13c80d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3607710958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c80d3840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13b80097a0 tx=0x7f13b802a100 comp rx=0 tx=0).stop 2024-05-04T07:50:33.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 -- 172.21.15.136:0/3607710958 shutdown_connections 2024-05-04T07:50:33.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3607710958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c80d3840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 -- 172.21.15.136:0/3607710958 >> 172.21.15.136:0/3607710958 conn(0x7f13c809e370 msgr2=0x7f13c80d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:33.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 -- 172.21.15.136:0/3607710958 shutdown_connections 2024-05-04T07:50:33.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.258+0000 7f13c7e00640 1 -- 172.21.15.136:0/3607710958 wait complete. 2024-05-04T07:50:33.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.259+0000 7f13c7e00640 1 Processor -- start 2024-05-04T07:50:33.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.260+0000 7f13c7e00640 1 -- start start 2024-05-04T07:50:33.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.260+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13c80b1c60 0x7f13c80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.260+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13c80b31f0 0x7f13c80cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8163ae0 con 0x7f13c80d3460 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13c80b2cd0 con 0x7f13c80b31f0 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f13c8163c60 con 0x7f13c80b1c60 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46838/0 (socket says 172.21.15.136:46838) 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 -- 172.21.15.136:0/3209378757 learned_addr learned my addr 172.21.15.136:0/3209378757 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c6a00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13c80b1c60 0x7f13c80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c6000640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13c80b31f0 0x7f13c80cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 -- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13c80b1c60 msgr2=0x7f13c80c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13c80b1c60 0x7f13c80c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 -- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13c80b31f0 msgr2=0x7f13c80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13c80b31f0 0x7f13c80cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.261+0000 7f13c7400640 1 -- 172.21.15.136:0/3209378757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c80cd900 con 0x7f13c80d3460 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13c7400640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c410 tx=0x7f13c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011790 con 0x7f13c80d3460 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c0017070 con 0x7f13c80d3460 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011bb0 con 0x7f13c80d3460 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c80cdbe0 con 0x7f13c80d3460 2024-05-04T07:50:33.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.262+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c80cd5a0 con 0x7f13c80d3460 2024-05-04T07:50:33.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.263+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8069400 con 0x7f13c80d3460 2024-05-04T07:50:33.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.264+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13c001c460 con 0x7f13c80d3460 2024-05-04T07:50:33.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.265+0000 7f13bf400640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 0x7f13a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.265+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f13c0097590 con 0x7f13c80d3460 2024-05-04T07:50:33.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.265+0000 7f13c6a00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 0x7f13a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.266+0000 7f13c6a00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 0x7f13a4078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13b8034000 tx=0x7f13b802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.270+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13c0021020 con 0x7f13c80d3460 2024-05-04T07:50:33.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.462+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13c8149070 con 0x7f13c80d3460 2024-05-04T07:50:33.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.465+0000 7f13bf400640 1 -- 172.21.15.136:0/3209378757 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f13c0060b10 con 0x7f13c80d3460 2024-05-04T07:50:33.466 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:33.466 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 msgr2=0x7f13a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 0x7f13a4078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13b8034000 tx=0x7f13b802e000 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 msgr2=0x7f13c814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c410 tx=0x7f13c000c8d0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 shutdown_connections 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13a40762d0 0x7f13a4078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13c80d3460 0x7f13c814b330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13c80b31f0 0x7f13c80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 --2- 172.21.15.136:0/3209378757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13c80b1c60 0x7f13c80c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 >> 172.21.15.136:0/3209378757 conn(0x7f13c809e370 msgr2=0x7f13c806e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 shutdown_connections 2024-05-04T07:50:33.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.468+0000 7f13c7e00640 1 -- 172.21.15.136:0/3209378757 wait complete. 2024-05-04T07:50:33.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:33.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.669+0000 7f031fe00640 1 Processor -- start 2024-05-04T07:50:33.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.669+0000 7f031fe00640 1 -- start start 2024-05-04T07:50:33.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03200cc6e0 0x7f032006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031fe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03200ceb20 con 0x7f03200cb730 2024-05-04T07:50:33.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031fe00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03200cee00 con 0x7f032015f6c0 2024-05-04T07:50:33.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f032015faa0 con 0x7f03200cc6e0 2024-05-04T07:50:33.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031f400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f03200cb730 0x7f032006e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:55390/0 (socket says 172.21.15.136:55390) 2024-05-04T07:50:33.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.671+0000 7f031f400640 1 -- 172.21.15.136:0/3288686827 learned_addr learned my addr 172.21.15.136:0/3288686827 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:33.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f0316000640 1 --2- 172.21.15.136:0/3288686827 >> v2:172.21.15.142:3300/0 conn(0x7f03200cc6e0 0x7f032006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271568358 0 0) 0x7f03200ceb20 con 0x7f03200cb730 2024-05-04T07:50:33.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0304003520 con 0x7f03200cb730 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2975669331 0 0) 0x7f0304003520 con 0x7f03200cb730 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 >> v2:172.21.15.142:3300/0 conn(0x7f03200cc6e0 msgr2=0x7f032006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 --2- 172.21.15.136:0/3288686827 >> v2:172.21.15.142:3300/0 conn(0x7f03200cc6e0 0x7f032006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 >> v1:172.21.15.142:6789/0 conn(0x7f032015f6c0 legacy=0x7f03200cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0320073a90 con 0x7f03200cb730 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f03180016f0 con 0x7f03200cb730 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 >> v1:172.21.15.136:6789/0 conn(0x7f03200cb730 legacy=0x7f032006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0304003aa0 0x7f0304003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03040052e0 0x7f030400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.672+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f032015faa0 con 0x7f0304004800 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f030400c1e0 con 0x7f03040052e0 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f030400c3e0 con 0x7f0304003aa0 2024-05-04T07:50:33.676 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f031f400640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03040052e0 0x7f030400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 -- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0304003aa0 msgr2=0x7f0304003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0304003aa0 0x7f0304003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 -- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03040052e0 msgr2=0x7f030400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03040052e0 0x7f030400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f0316000640 1 -- 172.21.15.136:0/3288686827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0304003520 con 0x7f0304004800 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.673+0000 7f031f400640 1 -- 172.21.15.136:0/3288686827 reap_dead start 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.674+0000 7f0316000640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0304004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0308009ac0 tx=0x7f0304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3758ad11e032f946 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.674+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308036070 con 0x7f0304004800 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.674+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0308031400 con 0x7f0304004800 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.674+0000 7f031e000640 1 -- 172.21.15.136:0/3288686827 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308009690 con 0x7f0304004800 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 -- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 msgr2=0x7f0304004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0304004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0308009ac0 tx=0x7f0304005830 comp rx=0 tx=0).stop 2024-05-04T07:50:33.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 -- 172.21.15.136:0/3288686827 shutdown_connections 2024-05-04T07:50:33.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 --2- 172.21.15.136:0/3288686827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0304004c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 -- 172.21.15.136:0/3288686827 >> 172.21.15.136:0/3288686827 conn(0x7f03200d09d0 msgr2=0x7f03200d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:33.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 -- 172.21.15.136:0/3288686827 shutdown_connections 2024-05-04T07:50:33.678 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.675+0000 7f031fe00640 1 -- 172.21.15.136:0/3288686827 wait complete. 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.677+0000 7f031fe00640 1 Processor -- start 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.677+0000 7f031fe00640 1 -- start start 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 0x7f032015d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032015d980 0x7f03200cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f03200cace0 con 0x7f0304004800 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f03200ce8d0 con 0x7f0320153370 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f03200cae60 con 0x7f032015d980 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46866/0 (socket says 172.21.15.136:46866) 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 -- 172.21.15.136:0/2153251482 learned_addr learned my addr 172.21.15.136:0/2153251482 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f0316000640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 0x7f032015d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 -- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032015d980 msgr2=0x7f03200cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032015d980 0x7f03200cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 -- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 msgr2=0x7f032015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 0x7f032015d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f031ea00640 1 -- 172.21.15.136:0/2153251482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03200c4440 con 0x7f0304004800 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.678+0000 7f0316000640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 0x7f032015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f031ea00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031000caa0 tx=0x7f031000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310003b70 con 0x7f0304004800 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310003d30 con 0x7f0304004800 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031000ab20 con 0x7f0304004800 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03200c46e0 con 0x7f0304004800 2024-05-04T07:50:33.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.679+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03200c4ca0 con 0x7f0304004800 2024-05-04T07:50:33.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.680+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0320069400 con 0x7f0304004800 2024-05-04T07:50:33.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.681+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f031000acc0 con 0x7f0304004800 2024-05-04T07:50:33.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.682+0000 7f0317400640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 0x7f02fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:33.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.682+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0310097b30 con 0x7f0304004800 2024-05-04T07:50:33.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.682+0000 7f0316000640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 0x7f02fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:33.683 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.683+0000 7f0316000640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 0x7f02fc078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0308033000 tx=0x7f0308008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:33.687 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.687+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f03100610b0 con 0x7f0304004800 2024-05-04T07:50:33.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.880+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f032015b6d0 con 0x7f0304004800 2024-05-04T07:50:33.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.883+0000 7f0317400640 1 -- 172.21.15.136:0/2153251482 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f031008ee20 con 0x7f0304004800 2024-05-04T07:50:33.884 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:33.884 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 msgr2=0x7f02fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 0x7f02fc078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0308033000 tx=0x7f0308008030 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 msgr2=0x7f0320153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031000caa0 tx=0x7f031000cf60 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 shutdown_connections 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f02fc0762d0 0x7f02fc078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f032015d980 0x7f03200cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320153370 0x7f032015d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 --2- 172.21.15.136:0/2153251482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0304004800 0x7f0320153ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 >> 172.21.15.136:0/2153251482 conn(0x7f03200d09d0 msgr2=0x7f032015a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 shutdown_connections 2024-05-04T07:50:33.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:33.886+0000 7f031fe00640 1 -- 172.21.15.136:0/2153251482 wait complete. 2024-05-04T07:50:33.919 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:34.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.117+0000 7fa10fe00640 1 Processor -- start 2024-05-04T07:50:34.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.117+0000 7fa10fe00640 1 -- start start 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.118+0000 7fa10fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa11015f6c0 0x7fa1100cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.118+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100cc6e0 0x7fa1100cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10fe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1100ceb20 con 0x7fa1100afbc0 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa11015faa0 con 0x7fa11015f6c0 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa1100ce8d0 con 0x7fa1100cc6e0 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10f400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa1100afbc0 0x7fa110072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52514/0 (socket says 172.21.15.136:52514) 2024-05-04T07:50:34.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10f400640 1 -- 172.21.15.136:0/2628284383 learned_addr learned my addr 172.21.15.136:0/2628284383 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:34.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa106000640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100cc6e0 0x7fa1100cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10ea00640 1 --2- 172.21.15.136:0/2628284383 >> v2:172.21.15.136:3300/0 conn(0x7fa11015f6c0 0x7fa1100cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10e000640 1 -- 172.21.15.136:0/2628284383 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338825920 0 0) 0x7fa1100ceb20 con 0x7fa1100afbc0 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.119+0000 7fa10e000640 1 -- 172.21.15.136:0/2628284383 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f4003520 con 0x7fa1100afbc0 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.120+0000 7fa10ea00640 1 -- 172.21.15.136:0/2628284383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100cc6e0 msgr2=0x7fa1100cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.120+0000 7fa10ea00640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100cc6e0 0x7fa1100cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.120+0000 7fa10ea00640 1 -- 172.21.15.136:0/2628284383 >> v1:172.21.15.136:6789/0 conn(0x7fa1100afbc0 legacy=0x7fa110072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.120+0000 7fa10ea00640 1 -- 172.21.15.136:0/2628284383 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1100cee00 con 0x7fa11015f6c0 2024-05-04T07:50:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10ea00640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa11015f6c0 0x7fa1100cb020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1000097a0 tx=0x7fa10002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae28353a6adf123e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10e000640 1 -- 172.21.15.136:0/2628284383 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100037070 con 0x7fa11015f6c0 2024-05-04T07:50:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10e000640 1 -- 172.21.15.136:0/2628284383 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10002ae40 con 0x7fa11015f6c0 2024-05-04T07:50:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10e000640 1 -- 172.21.15.136:0/2628284383 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100032660 con 0x7fa11015f6c0 2024-05-04T07:50:34.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10fe00640 1 -- 172.21.15.136:0/2628284383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa11015f6c0 msgr2=0x7fa1100cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10fe00640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa11015f6c0 0x7fa1100cb020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1000097a0 tx=0x7fa10002a0f0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10fe00640 1 -- 172.21.15.136:0/2628284383 shutdown_connections 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.121+0000 7fa10fe00640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1100cc6e0 0x7fa1100cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.122+0000 7fa10fe00640 1 --2- 172.21.15.136:0/2628284383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa11015f6c0 0x7fa1100cb020 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.122+0000 7fa10fe00640 1 -- 172.21.15.136:0/2628284383 >> 172.21.15.136:0/2628284383 conn(0x7fa1100d09d0 msgr2=0x7fa1100d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.122+0000 7fa10fe00640 1 -- 172.21.15.136:0/2628284383 shutdown_connections 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.122+0000 7fa10fe00640 1 -- 172.21.15.136:0/2628284383 wait complete. 2024-05-04T07:50:34.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.123+0000 7fa10fe00640 1 Processor -- start 2024-05-04T07:50:34.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.123+0000 7fa10fe00640 1 -- start start 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 0x7fa1100cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11015f6c0 0x7fa1100cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa1100cace0 con 0x7fa1100afbc0 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa110073d70 con 0x7fa1100cc6e0 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa1100cae60 con 0x7fa11015f6c0 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.124+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46062/0 (socket says 172.21.15.136:46062) 2024-05-04T07:50:34.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 -- 172.21.15.136:0/3753053797 learned_addr learned my addr 172.21.15.136:0/3753053797 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:34.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa106000640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 0x7fa1100cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10f400640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11015f6c0 0x7fa1100cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 -- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11015f6c0 msgr2=0x7fa1100cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11015f6c0 0x7fa1100cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 -- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 msgr2=0x7fa1100cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 0x7fa1100cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 -- 172.21.15.136:0/3753053797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11015d4a0 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa106000640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 0x7fa1100cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.125+0000 7fa10ea00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1000098c0 tx=0x7fa1000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.126+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100041030 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.126+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10002ac40 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.126+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100037040 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.126+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11015d780 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.126+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11015dd40 con 0x7fa1100afbc0 2024-05-04T07:50:34.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.127+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1100b3670 con 0x7fa1100afbc0 2024-05-04T07:50:34.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.128+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa100044070 con 0x7fa1100afbc0 2024-05-04T07:50:34.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.129+0000 7fa107400640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 0x7fa0ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.129+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa1000b7e90 con 0x7fa1100afbc0 2024-05-04T07:50:34.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.129+0000 7fa106000640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 0x7fa0ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.130+0000 7fa106000640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 0x7fa0ec078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1100caaa0 tx=0x7fa0f800b3a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.133+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1100b3670 con 0x7fa1100afbc0 2024-05-04T07:50:34.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.382+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa110069400 con 0x7fa1100afbc0 2024-05-04T07:50:34.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.383+0000 7fa107400640 1 -- 172.21.15.136:0/3753053797 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5186 (secure 0 0 0) 0x7fa100081410 con 0x7fa1100afbc0 2024-05-04T07:50:34.384 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:34.384 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:32.014369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:34.384 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 7 2024-05-04T07:50:34.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 msgr2=0x7fa0ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 0x7fa0ec078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa1100caaa0 tx=0x7fa0f800b3a0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 msgr2=0x7fa1100c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa1000098c0 tx=0x7fa1000046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 shutdown_connections 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0ec0762d0 0x7fa0ec078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa11015f6c0 0x7fa1100cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1100cc6e0 0x7fa1100cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 --2- 172.21.15.136:0/3753053797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1100afbc0 0x7fa1100c4920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 >> 172.21.15.136:0/3753053797 conn(0x7fa1100d09d0 msgr2=0x7fa1100b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 shutdown_connections 2024-05-04T07:50:34.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.386+0000 7fa10fe00640 1 -- 172.21.15.136:0/3753053797 wait complete. 2024-05-04T07:50:34.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:34.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.594+0000 7f6063e00640 1 Processor -- start 2024-05-04T07:50:34.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.594+0000 7f6063e00640 1 -- start start 2024-05-04T07:50:34.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.595+0000 7f6063e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60640ce8d0 0x7f60640cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.595+0000 7f6063e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60640cee00 con 0x7f60640afc80 2024-05-04T07:50:34.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.595+0000 7f6063e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60640cf0e0 con 0x7f606406f220 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.595+0000 7f6063e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f60640d1840 con 0x7f60640ce8d0 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.595+0000 7f605a000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60640ce8d0 0x7f60640cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f605a000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f60640ce8d0 0x7f60640cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46066/0 (socket says 172.21.15.136:46066) 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f6062a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f60640afc80 0x7f6064071d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52516/0 (socket says 172.21.15.136:52516) 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f605a000640 1 -- 172.21.15.136:0/373785224 learned_addr learned my addr 172.21.15.136:0/373785224 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f605a000640 1 -- 172.21.15.136:0/373785224 >> v1:172.21.15.142:6789/0 conn(0x7f606406f220 legacy=0x7f60640b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f605a000640 1 -- 172.21.15.136:0/373785224 >> v1:172.21.15.136:6789/0 conn(0x7f60640afc80 legacy=0x7f6064071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f605a000640 1 -- 172.21.15.136:0/373785224 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60640cf3c0 con 0x7f60640ce8d0 2024-05-04T07:50:34.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.596+0000 7f6062000640 1 -- 172.21.15.136:0/373785224 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277989755 0 0) 0x7f60640cee00 con 0x7f60640afc80 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.597+0000 7f605a000640 1 --2- 172.21.15.136:0/373785224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640cfea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f604c009870 tx=0x7f604c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67acabbf53f864d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.597+0000 7f6062000640 1 -- 172.21.15.136:0/373785224 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c037070 con 0x7f60640ce8d0 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.597+0000 7f6062000640 1 -- 172.21.15.136:0/373785224 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c032440 con 0x7f60640ce8d0 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.597+0000 7f6062000640 1 -- 172.21.15.136:0/373785224 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c032810 con 0x7f60640ce8d0 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 -- 172.21.15.136:0/373785224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 msgr2=0x7f60640cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 --2- 172.21.15.136:0/373785224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640cfea0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f604c009870 tx=0x7f604c02a250 comp rx=0 tx=0).stop 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 -- 172.21.15.136:0/373785224 shutdown_connections 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 --2- 172.21.15.136:0/373785224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640cfea0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 -- 172.21.15.136:0/373785224 >> 172.21.15.136:0/373785224 conn(0x7f60640d09d0 msgr2=0x7f60640d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 -- 172.21.15.136:0/373785224 shutdown_connections 2024-05-04T07:50:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.598+0000 7f6063e00640 1 -- 172.21.15.136:0/373785224 wait complete. 2024-05-04T07:50:34.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.600+0000 7f6063e00640 1 Processor -- start 2024-05-04T07:50:34.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.600+0000 7f6063e00640 1 -- start start 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 0x7f606414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60640afc80 0x7f60640c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f60640b0060 con 0x7f60640ce8d0 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f60640cf980 con 0x7f606406f220 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f60640b01e0 con 0x7f60640afc80 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46070/0 (socket says 172.21.15.136:46070) 2024-05-04T07:50:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 -- 172.21.15.136:0/217007566 learned_addr learned my addr 172.21.15.136:0/217007566 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6062a00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 0x7f606414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 -- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60640afc80 msgr2=0x7f60640c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60640afc80 0x7f60640c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 -- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 msgr2=0x7f606414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 0x7f606414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6063400640 1 -- 172.21.15.136:0/217007566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60640c6100 con 0x7f60640ce8d0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.601+0000 7f6062a00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 0x7f606414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f6063400640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c780 tx=0x7f605c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c017070 con 0x7f60640ce8d0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605c003da0 con 0x7f60640ce8d0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c0052b0 con 0x7f60640ce8d0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60640c63e0 con 0x7f60640ce8d0 2024-05-04T07:50:34.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.602+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60640c69a0 con 0x7f60640ce8d0 2024-05-04T07:50:34.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.603+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6064069400 con 0x7f60640ce8d0 2024-05-04T07:50:34.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.604+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f605c01a070 con 0x7f60640ce8d0 2024-05-04T07:50:34.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.606+0000 7f605b400640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 0x7f6040078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:34.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.606+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f605c096ff0 con 0x7f60640ce8d0 2024-05-04T07:50:34.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.606+0000 7f6062a00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 0x7f6040078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:34.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.607+0000 7f6062a00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 0x7f6040078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6054000f60 tx=0x7f6054009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:34.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.610+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f605c060600 con 0x7f60640ce8d0 2024-05-04T07:50:34.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.820+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60640d1060 con 0x7f60640ce8d0 2024-05-04T07:50:34.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.823+0000 7f605b400640 1 -- 172.21.15.136:0/217007566 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f605c05ff00 con 0x7f60640ce8d0 2024-05-04T07:50:34.824 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:34.824 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.825+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 msgr2=0x7f6040078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.825+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 0x7f6040078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6054000f60 tx=0x7f6054009040 comp rx=0 tx=0).stop 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.825+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 msgr2=0x7f60640c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.825+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c780 tx=0x7f605c00cc40 comp rx=0 tx=0).stop 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 shutdown_connections 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f60400762d0 0x7f6040078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60640ce8d0 0x7f60640c8250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60640afc80 0x7f60640c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 --2- 172.21.15.136:0/217007566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f606406f220 0x7f606414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 >> 172.21.15.136:0/217007566 conn(0x7f60640d09d0 msgr2=0x7f60640ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 shutdown_connections 2024-05-04T07:50:34.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:34.826+0000 7f6063e00640 1 -- 172.21.15.136:0/217007566 wait complete. 2024-05-04T07:50:35.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-04T07:50:26.961726+0000', 'modified': '2024-05-04T07:50:32.014369+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6833/4269415671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 4269415671}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 4269415671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-05-04T07:50:35.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-04T07:50:35.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-04T07:50:35.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.460+0000 7fc572000640 1 Processor -- start 2024-05-04T07:50:35.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.461+0000 7fc572000640 1 -- start start 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc572000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc56c0cb340 0x7fc56c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc572000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0ce5e0 0x7fc56c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc572000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56c0ccfa0 con 0x7fc56c145ad0 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc572000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc56c145eb0 con 0x7fc56c0cb340 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc572000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c0cd280 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc563e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc56c0cb340 0x7fc56c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc570c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc56c145ad0 0x7fc56c0c62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52520/0 (socket says 172.21.15.136:52520) 2024-05-04T07:50:35.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.462+0000 7fc570c00640 1 -- 172.21.15.136:0/2517340997 learned_addr learned my addr 172.21.15.136:0/2517340997 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc571600640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0ce5e0 0x7fc56c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc563e00640 1 -- 172.21.15.136:0/2517340997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0ce5e0 msgr2=0x7fc56c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc563e00640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0ce5e0 0x7fc56c0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc563e00640 1 -- 172.21.15.136:0/2517340997 >> v1:172.21.15.136:6789/0 conn(0x7fc56c145ad0 legacy=0x7fc56c0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc56be00640 1 -- 172.21.15.136:0/2517340997 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378418134 0 0) 0x7fc56c0ccfa0 con 0x7fc56c145ad0 2024-05-04T07:50:35.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.463+0000 7fc563e00640 1 -- 172.21.15.136:0/2517340997 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c0d0460 con 0x7fc56c0cb340 2024-05-04T07:50:35.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.464+0000 7fc563e00640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0cb340 0x7fc56c0c69f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0097a0 tx=0x7fc55c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c43a97acb51c3a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.464+0000 7fc56be00640 1 -- 172.21.15.136:0/2517340997 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037070 con 0x7fc56c0cb340 2024-05-04T07:50:35.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc56be00640 1 -- 172.21.15.136:0/2517340997 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c032440 con 0x7fc56c0cb340 2024-05-04T07:50:35.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc56be00640 1 -- 172.21.15.136:0/2517340997 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c032810 con 0x7fc56c0cb340 2024-05-04T07:50:35.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 -- 172.21.15.136:0/2517340997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0cb340 msgr2=0x7fc56c0c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0cb340 0x7fc56c0c69f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0097a0 tx=0x7fc55c02a180 comp rx=0 tx=0).stop 2024-05-04T07:50:35.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 -- 172.21.15.136:0/2517340997 shutdown_connections 2024-05-04T07:50:35.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0ce5e0 0x7fc56c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 --2- 172.21.15.136:0/2517340997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0cb340 0x7fc56c0c69f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.465+0000 7fc572000640 1 -- 172.21.15.136:0/2517340997 >> 172.21.15.136:0/2517340997 conn(0x7fc56c0cd490 msgr2=0x7fc56c0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.466+0000 7fc572000640 1 -- 172.21.15.136:0/2517340997 shutdown_connections 2024-05-04T07:50:35.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.466+0000 7fc572000640 1 -- 172.21.15.136:0/2517340997 wait complete. 2024-05-04T07:50:35.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.468+0000 7fc572000640 1 Processor -- start 2024-05-04T07:50:35.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.468+0000 7fc572000640 1 -- start start 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0cb340 0x7fc56c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c145ad0 0x7fc56c1e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0ccbc0 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c0c6f30 con 0x7fc56c145ad0 2024-05-04T07:50:35.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.469+0000 7fc572000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c0ccd40 con 0x7fc56c0cb340 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46092/0 (socket says 172.21.15.136:46092) 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 -- 172.21.15.136:0/1672613476 learned_addr learned my addr 172.21.15.136:0/1672613476 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc570c00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0cb340 0x7fc56c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 -- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0cb340 msgr2=0x7fc56c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0cb340 0x7fc56c0c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc571600640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c145ad0 0x7fc56c1e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 -- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c145ad0 msgr2=0x7fc56c1e6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c145ad0 0x7fc56c1e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 -- 172.21.15.136:0/1672613476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c0b5920 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.470+0000 7fc563e00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0097a0 tx=0x7fc55c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.471+0000 7fc569600640 1 -- 172.21.15.136:0/1672613476 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c037050 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.471+0000 7fc569600640 1 -- 172.21.15.136:0/1672613476 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c038040 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.471+0000 7fc569600640 1 -- 172.21.15.136:0/1672613476 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c004490 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.471+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c0b5c00 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.471+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c0b4c40 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.474 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.473+0000 7fc569600640 1 -- 172.21.15.136:0/1672613476 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc55c030980 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.475+0000 7fc569600640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 0x7fc5480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.475+0000 7fc569600640 1 -- 172.21.15.136:0/1672613476 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc55c0b8510 con 0x7fc56c0ce5e0 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.475+0000 7fc570c00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 0x7fc5480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.475+0000 7fc576391740 1 Processor -- start 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.476+0000 7fc576391740 1 -- start start 2024-05-04T07:50:35.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.476+0000 7fc570c00640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 0x7fc5480787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc554000f60 tx=0x7fc554009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da9616df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96118a0 0x563da9615610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563da957a790 con 0x563da9615b50 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563da951ff20 con 0x563da96118a0 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x563da9576750 con 0x563da9616a10 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46104/0 (socket says 172.21.15.136:46104) 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 -- 172.21.15.136:0/4185997258 learned_addr learned my addr 172.21.15.136:0/4185997258 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc570c00640 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da9616df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 -- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 msgr2=0x563da9616df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da9616df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 -- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96118a0 msgr2=0x563da9615610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96118a0 0x563da9615610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.477+0000 7fc571600640 1 -- 172.21.15.136:0/4185997258 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563da928c2d0 con 0x563da9615b50 2024-05-04T07:50:35.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.478+0000 7fc571600640 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc564007e90 tx=0x7fc56400d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0fc890ee3591cc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.478+0000 7fc561200640 1 -- 172.21.15.136:0/4185997258 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564003da0 con 0x563da9615b50 2024-05-04T07:50:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.478+0000 7fc561200640 1 -- 172.21.15.136:0/4185997258 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc564004030 con 0x563da9615b50 2024-05-04T07:50:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.478+0000 7fc561200640 1 -- 172.21.15.136:0/4185997258 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564004400 con 0x563da9615b50 2024-05-04T07:50:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- 172.21.15.136:0/4185997258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 msgr2=0x563da9615f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc564007e90 tx=0x7fc56400d750 comp rx=0 tx=0).stop 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- 172.21.15.136:0/4185997258 shutdown_connections 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9615f90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96118a0 0x563da9615610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 --2- 172.21.15.136:0/4185997258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da9616df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- 172.21.15.136:0/4185997258 >> 172.21.15.136:0/4185997258 conn(0x563da9613b10 msgr2=0x563da965c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- 172.21.15.136:0/4185997258 shutdown_connections 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- 172.21.15.136:0/4185997258 wait complete. 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.479+0000 7fc576391740 1 -- start start 2024-05-04T07:50:35.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.480+0000 7fc576391740 1 Processor -- start 2024-05-04T07:50:35.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 0x563da9633580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da96370f0 0x563da9637570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563da96425a0 con 0x563da9615b50 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563da95339c0 con 0x563da9616a10 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x563da9641a20 con 0x563da96370f0 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc576391740 10 client.0 _ll_register_callbacks cb 0x563da9500120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46106/0 (socket says 172.21.15.136:46106) 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 -- 172.21.15.136:0/1227930441 learned_addr learned my addr 172.21.15.136:0/1227930441 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc563e00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 0x563da9633580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 -- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da96370f0 msgr2=0x563da9637570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc571600640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da96370f0 0x563da9637570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da96370f0 0x563da9637570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 -- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 msgr2=0x563da9633580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 0x563da9633580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc570c00640 1 -- 172.21.15.136:0/1227930441 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563da93566b0 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.481+0000 7fc563e00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 0x563da9633580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc570c00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc554005d70 tx=0x7fc554000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c02916e892a45e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc559600640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554021430 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc554020dc0 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc564004030 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fc5540215d0 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc576391740 10 client.4389 fetch_fsmap learned FSMap version 7 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.482+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x563da9662e90 con 0x563da9615b50 2024-05-04T07:50:35.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc564004030 con 0x563da9615b50 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fc554021770 con 0x563da9615b50 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 20 client.4389 populate_metadata read hostname 'smithi136' 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da965db90 0x563da9661320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 4 client.4389 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 --> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563da95883a0 con 0x563da965db90 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.483+0000 7fc563e00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da965db90 0x563da9661320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.484+0000 7fc563e00640 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da965db90 0x563da9661320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631842de0f3c9c10 server_cookie=dcdc766e28583a7b in_seq=0 out_seq=0 2024-05-04T07:50:35.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.484+0000 7fc559600640 10 client.4389 ms_handle_connect on v2:172.21.15.142:6832/4269415671 2024-05-04T07:50:35.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.486+0000 7fc559600640 1 -- 172.21.15.136:0/1227930441 <== mds.0 v2:172.21.15.142:6832/4269415671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563da95883a0 con 0x563da965db90 2024-05-04T07:50:35.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.486+0000 7fc559600640 10 client.4389 handle_command_reply: tid=0 2024-05-04T07:50:35.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.486+0000 7fc576391740 1 client.4389 shutdown 2024-05-04T07:50:35.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.486+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 msgr2=0x563da965fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.486+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc554005d70 tx=0x7fc554000ed0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 shutdown_connections 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da96370f0 0x563da9637570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da9616a10 0x563da9633580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da965db90 0x563da9661320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 --2- 172.21.15.136:0/1227930441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da965fed0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc559600640 0 client.4389 ms_handle_reset on v2:172.21.15.142:6832/4269415671 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 >> 172.21.15.136:0/1227930441 conn(0x563da96118a0 msgr2=0x563da9610e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 shutdown_connections 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 1 -- 172.21.15.136:0/1227930441 wait complete. 2024-05-04T07:50:35.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.487+0000 7fc576391740 20 client.4389 trim_cache size 0 max 16384 2024-05-04T07:50:35.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.507+0000 7fc576391740 1 Processor -- start 2024-05-04T07:50:35.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 -- start start 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da96516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da9651c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1ff7e0 con 0x563da9615b50 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c14a890 con 0x563da96370f0 2024-05-04T07:50:35.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.508+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc56c1ff190 con 0x563da9616a10 2024-05-04T07:50:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46118/0 (socket says 172.21.15.136:46118) 2024-05-04T07:50:35.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 -- 172.21.15.136:0/4136954879 learned_addr learned my addr 172.21.15.136:0/4136954879 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 -- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 msgr2=0x563da96516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc563e00640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da96516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da96516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc571600640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da9651c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 -- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 msgr2=0x563da9651c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da9651c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc570c00640 1 -- 172.21.15.136:0/4136954879 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563da9676d70 con 0x563da9615b50 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.509+0000 7fc571600640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da9651c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.510+0000 7fc570c00640 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc5540014d0 tx=0x7fc55401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4731de8519f78f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.510+0000 7fc55be00640 1 -- 172.21.15.136:0/4136954879 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554038070 con 0x563da9615b50 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.510+0000 7fc55be00640 1 -- 172.21.15.136:0/4136954879 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554007570 con 0x563da9615b50 2024-05-04T07:50:35.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.510+0000 7fc55be00640 1 -- 172.21.15.136:0/4136954879 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55402f040 con 0x563da9615b50 2024-05-04T07:50:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- 172.21.15.136:0/4136954879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 msgr2=0x563da9641b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc5540014d0 tx=0x7fc55401d000 comp rx=0 tx=0).stop 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- 172.21.15.136:0/4136954879 shutdown_connections 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da9651c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9616a10 0x563da96516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 --2- 172.21.15.136:0/4136954879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9615b50 0x563da9641b70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- 172.21.15.136:0/4136954879 >> 172.21.15.136:0/4136954879 conn(0x563da96118a0 msgr2=0x563da9644990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- 172.21.15.136:0/4136954879 shutdown_connections 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- 172.21.15.136:0/4136954879 wait complete. 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.511+0000 7fc576391740 1 -- start start 2024-05-04T07:50:35.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.512+0000 7fc576391740 1 Processor -- start 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9615b50 0x563da9661ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da967f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563da965da10 con 0x563da9616a10 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563da965e7e0 con 0x563da96370f0 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x563da965e060 con 0x563da9615b50 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc576391740 10 client.0 _ll_register_callbacks cb 0x7fc5540012f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:50:35.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc563e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc563e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46128/0 (socket says 172.21.15.136:46128) 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.513+0000 7fc563e00640 1 -- 172.21.15.136:0/350951545 learned_addr learned my addr 172.21.15.136:0/350951545 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc571600640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da967f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 -- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9615b50 msgr2=0x563da9661ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9615b50 0x563da9661ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 -- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 msgr2=0x563da967f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da967f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 -- 172.21.15.136:0/350951545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563da9636e20 con 0x563da9616a10 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc571600640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da967f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc563e00640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc55c02a770 tx=0x7fc55c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dd09862bc5a412 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc559600640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c080f20 con 0x563da9616a10 2024-05-04T07:50:35.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc55c0b80b0 con 0x563da9616a10 2024-05-04T07:50:35.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.514+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc554007570 con 0x563da9616a10 2024-05-04T07:50:35.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fc55c081b10 con 0x563da9616a10 2024-05-04T07:50:35.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 10 client.4395 fetch_fsmap learned FSMap version 7 2024-05-04T07:50:35.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x563da966f2b0 con 0x563da9616a10 2024-05-04T07:50:35.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554007570 con 0x563da9616a10 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fc55c0b62d0 con 0x563da9616a10 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 20 client.4395 populate_metadata read hostname 'smithi136' 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da9610ea0 0x563da9635b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 4 client.4395 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.515+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 --> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] -- command(tid 0: {"prefix": "status"}) -- 0x563da9582210 con 0x563da9610ea0 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.516+0000 7fc570c00640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da9610ea0 0x563da9635b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.517+0000 7fc570c00640 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da9610ea0 0x563da9635b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd64ec2be43b166 server_cookie=90671f1982bb6989 in_seq=0 out_seq=0 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.517+0000 7fc559600640 10 client.4395 ms_handle_connect on v2:172.21.15.142:6832/4269415671 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc559600640 1 -- 172.21.15.136:0/350951545 <== mds.0 v2:172.21.15.142:6832/4269415671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x563da9582210 con 0x563da9610ea0 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc559600640 10 client.4395 handle_command_reply: tid=0 2024-05-04T07:50:35.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 client.4395 shutdown 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 msgr2=0x563da967f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc55c02a770 tx=0x7fc55c02a680 comp rx=0 tx=0).stop 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 shutdown_connections 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da96370f0 0x563da967f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x563da9610ea0 0x563da9635b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563da9616a10 0x563da967f270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 --2- 172.21.15.136:0/350951545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563da9615b50 0x563da9661ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 >> 172.21.15.136:0/350951545 conn(0x563da96118a0 msgr2=0x563da9644990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc559600640 0 client.4395 ms_handle_reset on v2:172.21.15.142:6832/4269415671 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 shutdown_connections 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 1 -- 172.21.15.136:0/350951545 wait complete. 2024-05-04T07:50:35.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.518+0000 7fc576391740 20 client.4395 trim_cache size 0 max 16384 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "9ecc10c5-f8dd-4dd0-88f7-548a507c724d", 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4267, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 8.0296571750000005, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 7, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 24, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 24, 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 14.08116119 2024-05-04T07:50:35.521 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:50:35.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 msgr2=0x7fc5480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 0x7fc5480787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc554000f60 tx=0x7fc554009040 comp rx=0 tx=0).stop 2024-05-04T07:50:35.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 msgr2=0x7fc56c1e67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0097a0 tx=0x7fc55c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 shutdown_connections 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc548076320 0x7fc5480787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc56c145ad0 0x7fc56c1e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc56c0ce5e0 0x7fc56c1e67c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 --2- 172.21.15.136:0/1672613476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc56c0cb340 0x7fc56c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 >> 172.21.15.136:0/1672613476 conn(0x7fc56c0cd490 msgr2=0x7fc56c06c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 shutdown_connections 2024-05-04T07:50:35.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.519+0000 7fc572000640 1 -- 172.21.15.136:0/1672613476 wait complete. 2024-05-04T07:50:35.538 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T07:50:35.538 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:35.538 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:50:35.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.732+0000 7f30b2e00640 1 Processor -- start 2024-05-04T07:50:35.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.732+0000 7f30b2e00640 1 -- start start 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.733+0000 7f30b2e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30ac145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.733+0000 7f30b2e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f30ac1463a0 0x7f30ac071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.733+0000 7f30b2e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac146900 con 0x7f30ac072430 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.733+0000 7f30b2e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac140320 con 0x7f30ac1463a0 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.733+0000 7f30b2e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15de40 con 0x7f30ac13ff40 2024-05-04T07:50:35.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30b0e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f30ac072430 0x7f30ac142640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52530/0 (socket says 172.21.15.136:52530) 2024-05-04T07:50:35.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30b0e00640 1 -- 172.21.15.136:0/1740912825 learned_addr learned my addr 172.21.15.136:0/1740912825 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:35.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30a3400640 1 --2- 172.21.15.136:0/1740912825 >> v2:172.21.15.142:3300/0 conn(0x7f30ac1463a0 0x7f30ac071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30abe00640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30ac145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581796539 0 0) 0x7f30ac146900 con 0x7f30ac072430 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3090003520 con 0x7f30ac072430 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.734+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4096950686 0 0) 0x7f3090003520 con 0x7f30ac072430 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 msgr2=0x7f30ac145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30ac145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 >> v2:172.21.15.142:3300/0 conn(0x7f30ac1463a0 msgr2=0x7f30ac071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 --2- 172.21.15.136:0/1740912825 >> v2:172.21.15.142:3300/0 conn(0x7f30ac1463a0 0x7f30ac071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac15d7f0 con 0x7f30ac072430 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f30a40016f0 con 0x7f30ac072430 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 >> v1:172.21.15.136:6789/0 conn(0x7f30ac072430 legacy=0x7f30ac142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3090003a70 0x7f3090003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3090004800 0x7f3090004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac15de40 con 0x7f3090004800 2024-05-04T07:50:35.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f309000b9c0 con 0x7f3090003a70 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f309000bbc0 con 0x7f30ac13ff40 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3090004800 0x7f3090004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30abe00640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3090003a70 0x7f3090003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30b0e00640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 -- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 msgr2=0x7f30900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f30ac13ff40 0x7f30900051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 -- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3090003a70 msgr2=0x7f3090003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3090003a70 0x7f3090003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.735+0000 7f30a3400640 1 -- 172.21.15.136:0/1740912825 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090003520 con 0x7f3090004800 2024-05-04T07:50:35.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.736+0000 7f30a3400640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3090004800 0x7f3090004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3094009fc0 tx=0x7f3090005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2563f51cf5535b09 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094009c10 con 0x7f3090004800 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3094036070 con 0x7f3090004800 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30ab400640 1 -- 172.21.15.136:0/1740912825 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309402d070 con 0x7f3090004800 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 -- 172.21.15.136:0/1740912825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3090004800 msgr2=0x7f3090004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1740912825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3090004800 0x7f3090004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3094009fc0 tx=0x7f3090005830 comp rx=0 tx=0).stop 2024-05-04T07:50:35.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b0e00640 1 -- 172.21.15.136:0/1740912825 reap_dead start 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 -- 172.21.15.136:0/1740912825 shutdown_connections 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 -- 172.21.15.136:0/1740912825 >> 172.21.15.136:0/1740912825 conn(0x7f30ac0d0c30 msgr2=0x7f30ac0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 -- 172.21.15.136:0/1740912825 shutdown_connections 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.737+0000 7f30b2e00640 1 -- 172.21.15.136:0/1740912825 wait complete. 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.739+0000 7f30b2e00640 1 Processor -- start 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.739+0000 7f30b2e00640 1 -- start start 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3090004800 0x7f30ac13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 0x7f30ac0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac161910 con 0x7f30ac15a1b0 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0c6ac0 con 0x7f30ac1f09f0 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b2e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15d4a0 con 0x7f3090004800 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.740+0000 7f30b0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46150/0 (socket says 172.21.15.136:46150) 2024-05-04T07:50:35.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 -- 172.21.15.136:0/1628551194 learned_addr learned my addr 172.21.15.136:0/1628551194 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30a3400640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 0x7f30ac0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30abe00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3090004800 0x7f30ac13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 -- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3090004800 msgr2=0x7f30ac13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3090004800 0x7f30ac13ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 -- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 msgr2=0x7f30ac0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 0x7f30ac0cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 -- 172.21.15.136:0/1628551194 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac15ab80 con 0x7f30ac15a1b0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30a3400640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 0x7f30ac0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30b0e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0743a0 tx=0x7f30a400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40075a0 con 0x7f30ac15a1b0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.741+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40047e0 con 0x7f30ac15a1b0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.742+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4004bd0 con 0x7f30ac15a1b0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.742+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac0ce830 con 0x7f30ac15a1b0 2024-05-04T07:50:35.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.742+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac0b4f90 con 0x7f30ac15a1b0 2024-05-04T07:50:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.743+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac069400 con 0x7f30ac15a1b0 2024-05-04T07:50:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.744+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30a40133d0 con 0x7f30ac15a1b0 2024-05-04T07:50:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.745+0000 7f30a8c00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 0x7f3088078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:35.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.745+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f30a4097190 con 0x7f30ac15a1b0 2024-05-04T07:50:35.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.745+0000 7f30abe00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 0x7f3088078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:35.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.746+0000 7f30abe00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 0x7f3088078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0cfce0 tx=0x7f309c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:35.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:35.749+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30a40607a0 con 0x7f30ac15a1b0 2024-05-04T07:50:36.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.001+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f30ac0c7970 con 0x7f30ac15a1b0 2024-05-04T07:50:36.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.002+0000 7f30a8c00640 1 -- 172.21.15.136:0/1628551194 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f30a40600a0 con 0x7f30ac15a1b0 2024-05-04T07:50:36.003 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-04T07:50:36.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 msgr2=0x7f3088078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:36.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 0x7f3088078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0cfce0 tx=0x7f309c008040 comp rx=0 tx=0).stop 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 msgr2=0x7f30ac15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0743a0 tx=0x7f30a400d950 comp rx=0 tx=0).stop 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 shutdown_connections 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f30880762d0 0x7f3088078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30ac15a1b0 0x7f30ac15a640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:36.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30ac1f09f0 0x7f30ac0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:36.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 --2- 172.21.15.136:0/1628551194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3090004800 0x7f30ac13ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:36.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.005+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 >> 172.21.15.136:0/1628551194 conn(0x7f30ac0d0c30 msgr2=0x7f30ac13c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:36.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.006+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 shutdown_connections 2024-05-04T07:50:36.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36.006+0000 7f30b2e00640 1 -- 172.21.15.136:0/1628551194 wait complete. 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:50:36.024 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-04T07:50:36.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:36.025 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-05-04T07:50:36.074 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:50:36.075 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-05-04T07:50:36.076 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:50:36.077 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-04T07:50:36.077 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:50:36.077 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:50:36.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-05-04T07:50:36.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-05-04T07:50:36.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-05-04T07:50:36.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-04T07:50:36.078 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:50:36.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:50:36.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:36.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:36.553 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:50:36.620 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-05-04T07:50:36.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:36.624 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-05-04T07:50:36.671 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-05-04T07:50:36.671 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:50:36.672 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:50:36.672 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:50:36.672 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:50:36.672 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:50:36.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:50:37.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:37.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:37.489 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:50:37.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:37.542 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-05-04T07:50:37.628 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:50:37.628 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:50:37.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:50:37.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-04T07:50:37.629 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:50:37.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:50:37.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:37.801 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-04T07:50:37.801 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:50:37.801 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:50:37.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-04T07:50:37.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-04T07:50:37.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-04T07:50:37.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-04T07:50:37.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-04T07:50:37.802 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:50:37.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:50:38.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:38.116 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:50:38.116 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:50:38.116 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-05-04T07:50:38.116 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-05-04T07:50:38.116 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:50:38.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:50:38.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:38.309 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-04T07:50:38.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:50:38.309 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:38.348 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-04T07:50:38.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:50:38.349 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:38.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-05-04T07:50:38.550 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T07:50:38.604 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-05-04T07:50:38.604 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-05-04T07:50:38.605 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T07:50:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T07:50:38.607 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T07:50:38.607 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-05-04T07:50:38.607 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:50:38.607 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:50:38.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:38.608 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-05-04T07:50:38.652 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-04T07:50:38.652 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-04T07:50:38.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo modprobe fuse 2024-05-04T07:50:38.771 DEBUG:teuthology.orchestra.run.smithi136:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T07:50:38.815 INFO:teuthology.orchestra.run.smithi136.stdout:/proc 2024-05-04T07:50:38.817 INFO:teuthology.orchestra.run.smithi136.stdout:/sys 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/dev 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/security 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/shm 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/pts 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/run 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/cgroup 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/pstore 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/bpf 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/ 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/selinux 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/hugepages 2024-05-04T07:50:38.818 INFO:teuthology.orchestra.run.smithi136.stdout:/dev/mqueue 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/debug 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/tracing 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/fs/fuse/connections 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/sys/kernel/config 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/run/user/1000 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T07:50:38.819 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns 2024-05-04T07:50:38.820 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:50:38.820 INFO:teuthology.orchestra.run.smithi136.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:50:38.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:38.821 DEBUG:teuthology.orchestra.run.smithi136:> ls /sys/fs/fuse/connections 2024-05-04T07:50:38.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:2024-05-04T07:50:38.889+0000 7feef7920480 -1 init, newargv = 0x561ac25997a0 newargc=15 2024-05-04T07:50:38.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[39838]: starting ceph client 2024-05-04T07:50:38.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[39838]: starting fuse 2024-05-04T07:50:38.904 INFO:teuthology.orchestra.run.smithi136.stdout:40 2024-05-04T07:50:38.904 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> sudo stdin-killer -- python3 -c ' 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> import glob 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> import re 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> import os 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> import subprocess 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> def _find_admin_socket(client_name): 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> files = glob.glob(asok_path) 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> # Given a non-glob path, it better be there 2024-05-04T07:50:38.905 DEBUG:teuthology.orchestra.run.smithi136:> if "*" not in asok_path: 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> assert(len(files) == 1) 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> return files[0] 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> for f in files: 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> contents = proc_f.read() 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> if mountpoint in contents: 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> return f 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> print(_find_admin_socket("client.admin")) 2024-05-04T07:50:38.906 DEBUG:teuthology.orchestra.run.smithi136:> ' 2024-05-04T07:50:39.086 INFO:teuthology.orchestra.run.smithi136.stdout:/var/run/ceph/ceph-client.admin.39838.asok 2024-05-04T07:50:39.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:39.103 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.39838.asok 2024-05-04T07:50:39.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:39.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.39838.asok status 2024-05-04T07:50:39.327 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "metadata": { 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_sha1": "25eb20a061356442d4a1c711818ce2e5848c382d", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.0.0-3500-g25eb20a0 (25eb20a061356442d4a1c711818ce2e5848c382d) squid (dev)", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "entity_id": "admin", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "hostname": "smithi136", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "pid": "39838", 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "root": "/" 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_count": 0, 2024-05-04T07:50:39.328 INFO:teuthology.orchestra.run.smithi136.stdout: "dentry_pinned_count": 0, 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4410, 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "inst": { 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "name": { 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "client", 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "num": 4410 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 4180909856 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:50:39.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": { 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "type": "v1", 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "addr": "192.168.0.1:0", 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "nonce": 4180909856 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "inst_str": "client.4410 192.168.0.1:0/4180909856", 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "addr_str": "192.168.0.1:0/4180909856", 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "inode_count": 1, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_epoch": 7, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch": 24, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_epoch_barrier": 0, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "blocklisted": false, 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs" 2024-05-04T07:50:39.330 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:50:39.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:39.343 DEBUG:teuthology.orchestra.run.smithi136:> stat --file-system '--printf=%T 2024-05-04T07:50:39.343 DEBUG:teuthology.orchestra.run.smithi136:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:39.391 INFO:teuthology.orchestra.run.smithi136.stdout:fuseblk 2024-05-04T07:50:39.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:39.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:39.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:39.516 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-04T07:50:39.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:50:39.669 INFO:teuthology.orchestra.run.smithi136.stdout:# file: . 2024-05-04T07:50:39.669 INFO:teuthology.orchestra.run.smithi136.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-04T07:50:39.669 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:39.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:50:39.679 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:39.679 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:50:39.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:50:39.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.976+0000 7f5c42000640 1 Processor -- start 2024-05-04T07:50:39.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.976+0000 7f5c42000640 1 -- start start 2024-05-04T07:50:39.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.977+0000 7f5c42000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c3c0cb340 0x7f5c3c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.977+0000 7f5c42000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c42000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c0ccfa0 con 0x7f5c3c145ad0 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c42000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3c145eb0 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c42000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3c0cd280 con 0x7f5c3c0cb340 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46156/0 (socket says 172.21.15.136:46156) 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 -- 172.21.15.136:0/1050747013 learned_addr learned my addr 172.21.15.136:0/1050747013 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c33e00640 1 --2- 172.21.15.136:0/1050747013 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c0cb340 0x7f5c3c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 -- 172.21.15.136:0/1050747013 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c0cb340 msgr2=0x7f5c3c0c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:39.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 --2- 172.21.15.136:0/1050747013 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c0cb340 0x7f5c3c0c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 -- 172.21.15.136:0/1050747013 >> v1:172.21.15.142:6789/0 conn(0x7f5c3c145ad0 legacy=0x7f5c3c0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.978+0000 7f5c41600640 1 -- 172.21.15.136:0/1050747013 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c0d0460 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c41600640 1 --2- 172.21.15.136:0/1050747013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c076730 tx=0x7f5c3402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d12bd737e5e43f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c3be00640 1 -- 172.21.15.136:0/1050747013 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34036070 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c3be00640 1 -- 172.21.15.136:0/1050747013 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c34031600 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c3be00640 1 -- 172.21.15.136:0/1050747013 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c340319d0 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c42000640 1 -- 172.21.15.136:0/1050747013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c0ce5e0 msgr2=0x7f5c3c0cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c42000640 1 --2- 172.21.15.136:0/1050747013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c076730 tx=0x7f5c3402a6a0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c42000640 1 -- 172.21.15.136:0/1050747013 shutdown_connections 2024-05-04T07:50:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c42000640 1 --2- 172.21.15.136:0/1050747013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0cea10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.980+0000 7f5c42000640 1 --2- 172.21.15.136:0/1050747013 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c0cb340 0x7f5c3c0c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.981+0000 7f5c42000640 1 -- 172.21.15.136:0/1050747013 >> 172.21.15.136:0/1050747013 conn(0x7f5c3c0cd490 msgr2=0x7f5c3c0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.981+0000 7f5c42000640 1 -- 172.21.15.136:0/1050747013 shutdown_connections 2024-05-04T07:50:39.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.981+0000 7f5c42000640 1 -- 172.21.15.136:0/1050747013 wait complete. 2024-05-04T07:50:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.983+0000 7f5c42000640 1 Processor -- start 2024-05-04T07:50:39.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.983+0000 7f5c42000640 1 -- start start 2024-05-04T07:50:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c3c0cb340 0x7f5c3c13d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0ccbc0 con 0x7f5c3c145ad0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0c6f30 con 0x7f5c3c0cb340 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c42000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c0ccd40 con 0x7f5c3c0ce5e0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46164/0 (socket says 172.21.15.136:46164) 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 -- 172.21.15.136:0/3307540416 learned_addr learned my addr 172.21.15.136:0/3307540416 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c40c00640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c3c0cb340 0x7f5c3c13d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 -- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c0ce5e0 msgr2=0x7f5c3c0b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 -- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c3c0cb340 msgr2=0x7f5c3c13d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c3c0cb340 0x7f5c3c13d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.984+0000 7f5c41600640 1 -- 172.21.15.136:0/3307540416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c1f50b0 con 0x7f5c3c145ad0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c41600640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c3402ac90 tx=0x7f5c34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:39.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34036050 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c34042070 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34009510 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c1f9450 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.985+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c1f5640 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.986+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c069400 con 0x7f5c3c145ad0 2024-05-04T07:50:39.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.987+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c34007bd0 con 0x7f5c3c145ad0 2024-05-04T07:50:39.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.988+0000 7f5c39600640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 0x7f5c18078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:39.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.988+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c340b8730 con 0x7f5c3c145ad0 2024-05-04T07:50:39.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.989+0000 7f5c40c00640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 0x7f5c18078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:39.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.989+0000 7f5c40c00640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 0x7f5c18078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00a750 tx=0x7f5c2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:39.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:39.993+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c34081d40 con 0x7f5c3c145ad0 2024-05-04T07:50:40.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.215+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c3c0ce2c0 con 0x7f5c3c145ad0 2024-05-04T07:50:40.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.216+0000 7f5c39600640 1 -- 172.21.15.136:0/3307540416 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5c34081640 con 0x7f5c3c145ad0 2024-05-04T07:50:40.217 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 msgr2=0x7f5c18078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 0x7f5c18078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00a750 tx=0x7f5c2c008040 comp rx=0 tx=0).stop 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 msgr2=0x7f5c3c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c3402ac90 tx=0x7f5c34004a40 comp rx=0 tx=0).stop 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 shutdown_connections 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5c180762d0 0x7f5c18078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c3c145ad0 0x7f5c3c0b1b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c0ce5e0 0x7f5c3c0b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 --2- 172.21.15.136:0/3307540416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c3c0cb340 0x7f5c3c13d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 >> 172.21.15.136:0/3307540416 conn(0x7f5c3c0cd490 msgr2=0x7f5c3c06dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:40.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 shutdown_connections 2024-05-04T07:50:40.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.219+0000 7f5c42000640 1 -- 172.21.15.136:0/3307540416 wait complete. 2024-05-04T07:50:40.239 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:50:40.239 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:50:40.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:50:40.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.537+0000 7fef36400640 1 Processor -- start 2024-05-04T07:50:40.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.538+0000 7fef36400640 1 -- start start 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.539+0000 7fef36400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fef300cfa70 0x7fef300cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.539+0000 7fef36400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fef300d0420 0x7fef300b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.539+0000 7fef36400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef300d0a10 con 0x7fef3015f0e0 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.539+0000 7fef36400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fef300b8850 con 0x7fef300cfa70 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.539+0000 7fef36400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fef300d0cf0 con 0x7fef300d0420 2024-05-04T07:50:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef35000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fef3015f0e0 0x7fef300d58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:52544/0 (socket says 172.21.15.136:52544) 2024-05-04T07:50:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef35000640 1 -- 172.21.15.136:0/382521154 learned_addr learned my addr 172.21.15.136:0/382521154 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2fe00640 1 --2- 172.21.15.136:0/382521154 >> v2:172.21.15.136:3300/0 conn(0x7fef300cfa70 0x7fef300cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef35a00640 1 --2- 172.21.15.136:0/382521154 >> v2:172.21.15.142:3300/0 conn(0x7fef300d0420 0x7fef300b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2f400640 1 -- 172.21.15.136:0/382521154 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496901677 0 0) 0x7fef300d0a10 con 0x7fef3015f0e0 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2f400640 1 -- 172.21.15.136:0/382521154 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef14003520 con 0x7fef3015f0e0 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2fe00640 1 -- 172.21.15.136:0/382521154 >> v2:172.21.15.142:3300/0 conn(0x7fef300d0420 msgr2=0x7fef300b92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2fe00640 1 --2- 172.21.15.136:0/382521154 >> v2:172.21.15.142:3300/0 conn(0x7fef300d0420 0x7fef300b92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2fe00640 1 -- 172.21.15.136:0/382521154 >> v1:172.21.15.136:6789/0 conn(0x7fef3015f0e0 legacy=0x7fef300d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.540+0000 7fef2fe00640 1 -- 172.21.15.136:0/382521154 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300b8aa0 con 0x7fef300cfa70 2024-05-04T07:50:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.541+0000 7fef2fe00640 1 --2- 172.21.15.136:0/382521154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef300cfa70 0x7fef300cfee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef300d19a0 tx=0x7fef1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3873913174dfdd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef2f400640 1 -- 172.21.15.136:0/382521154 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18037070 con 0x7fef300cfa70 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef2f400640 1 -- 172.21.15.136:0/382521154 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef18032440 con 0x7fef300cfa70 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef2f400640 1 -- 172.21.15.136:0/382521154 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18032810 con 0x7fef300cfa70 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 -- 172.21.15.136:0/382521154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef300cfa70 msgr2=0x7fef300cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 --2- 172.21.15.136:0/382521154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef300cfa70 0x7fef300cfee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef300d19a0 tx=0x7fef1802a230 comp rx=0 tx=0).stop 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 -- 172.21.15.136:0/382521154 shutdown_connections 2024-05-04T07:50:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 --2- 172.21.15.136:0/382521154 >> v2:172.21.15.142:3300/0 conn(0x7fef300d0420 0x7fef300b92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 --2- 172.21.15.136:0/382521154 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef300cfa70 0x7fef300cfee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 -- 172.21.15.136:0/382521154 >> 172.21.15.136:0/382521154 conn(0x7fef3009e380 msgr2=0x7fef300d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 -- 172.21.15.136:0/382521154 shutdown_connections 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.542+0000 7fef36400640 1 -- 172.21.15.136:0/382521154 wait complete. 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.544+0000 7fef36400640 1 Processor -- start 2024-05-04T07:50:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.544+0000 7fef36400640 1 -- start start 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 0x7fef30151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 0x7fef301f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fef300d3d40 con 0x7fef3015f0e0 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fef3015f4c0 con 0x7fef300cfa70 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.545+0000 7fef36400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fef300b97e0 con 0x7fef300d0420 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46184/0 (socket says 172.21.15.136:46184) 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 -- 172.21.15.136:0/2177844836 learned_addr learned my addr 172.21.15.136:0/2177844836 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35000640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 0x7fef30151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef2fe00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 0x7fef301f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 -- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 msgr2=0x7fef301f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 0x7fef301f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 -- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 msgr2=0x7fef30151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 0x7fef30151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 -- 172.21.15.136:0/2177844836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30152000 con 0x7fef3015f0e0 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef2fe00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 0x7fef301f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35000640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 0x7fef30151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.546+0000 7fef35a00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fef2800e930 tx=0x7fef2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.547+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28017070 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.547+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2800c980 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.547+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2800cd70 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.547+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301f83f0 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.547+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301f89b0 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.548+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30069400 con 0x7fef3015f0e0 2024-05-04T07:50:40.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.549+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef2801a070 con 0x7fef3015f0e0 2024-05-04T07:50:40.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.550+0000 7fef2cc00640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 0x7fef0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:40.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.550+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fef280979d0 con 0x7fef3015f0e0 2024-05-04T07:50:40.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.550+0000 7fef35000640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 0x7fef0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:40.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.551+0000 7fef35000640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 0x7fef0c078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef200015a0 tx=0x7fef20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:40.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.555+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef30152000 con 0x7fef3015f0e0 2024-05-04T07:50:40.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.772+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef3006ce90 con 0x7fef3015f0e0 2024-05-04T07:50:40.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.773+0000 7fef2cc00640 1 -- 172.21.15.136:0/2177844836 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fef28061010 con 0x7fef3015f0e0 2024-05-04T07:50:40.774 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 msgr2=0x7fef0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 0x7fef0c078790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef200015a0 tx=0x7fef20009040 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 msgr2=0x7fef300d2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fef2800e930 tx=0x7fef2800edf0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 shutdown_connections 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fef0c0762d0 0x7fef0c078790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fef3015f0e0 0x7fef300d2b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef300d0420 0x7fef301f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 --2- 172.21.15.136:0/2177844836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef300cfa70 0x7fef30151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:40.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.776+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 >> 172.21.15.136:0/2177844836 conn(0x7fef3009e380 msgr2=0x7fef300d58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:40.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.777+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 shutdown_connections 2024-05-04T07:50:40.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:40.777+0000 7fef36400640 1 -- 172.21.15.136:0/2177844836 wait complete. 2024-05-04T07:50:40.795 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi136.front.sepia.ceph.com... 2024-05-04T07:50:40.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:40.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-04T07:50:40.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi136.stderr:ceph-fuse[39838]: fuse finished with error 0 and tester_r 0 2024-05-04T07:50:40.873 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:50:43.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:50:43.920 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:50:46.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:50:46.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:50:46.975 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-04T07:50:47.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:47.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.253+0000 7f6a9ce00640 1 Processor -- start 2024-05-04T07:50:47.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.253+0000 7f6a9ce00640 1 -- start start 2024-05-04T07:50:47.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a9ce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a9815f190 0x7f6a980cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a9ce00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a980cc6f0 0x7f6a980ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a9ce00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9815f570 con 0x7f6a980cf960 2024-05-04T07:50:47.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a9ce00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6a980c6940 con 0x7f6a980cc6f0 2024-05-04T07:50:47.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a9ce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a980ccb80 con 0x7f6a9815f190 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a95400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a980cc6f0 0x7f6a980ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a95400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a980cc6f0 0x7f6a980ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38804/0 (socket says 172.21.15.136:38804) 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.255+0000 7f6a95400640 1 -- 172.21.15.136:0/2824370210 learned_addr learned my addr 172.21.15.136:0/2824370210 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.256+0000 7f6a95e00640 1 --2- 172.21.15.136:0/2824370210 >> v2:172.21.15.142:3300/0 conn(0x7f6a9815f190 0x7f6a980cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.256+0000 7f6a95400640 1 -- 172.21.15.136:0/2824370210 >> v2:172.21.15.142:3300/0 conn(0x7f6a9815f190 msgr2=0x7f6a980cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.256+0000 7f6a95400640 1 --2- 172.21.15.136:0/2824370210 >> v2:172.21.15.142:3300/0 conn(0x7f6a9815f190 0x7f6a980cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.256+0000 7f6a95400640 1 -- 172.21.15.136:0/2824370210 >> v1:172.21.15.142:6789/0 conn(0x7f6a980cf960 legacy=0x7f6a980cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:47.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.256+0000 7f6a95400640 1 -- 172.21.15.136:0/2824370210 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a980c6010 con 0x7f6a980cc6f0 2024-05-04T07:50:47.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.257+0000 7f6a95400640 1 --2- 172.21.15.136:0/2824370210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cc6f0 0x7f6a980ae870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a98071ea0 tx=0x7f6a8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54de991e70b3fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.257+0000 7f6a94a00640 1 -- 172.21.15.136:0/2824370210 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80037070 con 0x7f6a980cc6f0 2024-05-04T07:50:47.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.257+0000 7f6a94a00640 1 -- 172.21.15.136:0/2824370210 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a80032440 con 0x7f6a980cc6f0 2024-05-04T07:50:47.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.257+0000 7f6a94a00640 1 -- 172.21.15.136:0/2824370210 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80032810 con 0x7f6a980cc6f0 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 -- 172.21.15.136:0/2824370210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cc6f0 msgr2=0x7f6a980ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/2824370210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cc6f0 0x7f6a980ae870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a98071ea0 tx=0x7f6a8002a1e0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 -- 172.21.15.136:0/2824370210 shutdown_connections 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/2824370210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cc6f0 0x7f6a980ae870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/2824370210 >> v2:172.21.15.142:3300/0 conn(0x7f6a9815f190 0x7f6a980cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 -- 172.21.15.136:0/2824370210 >> 172.21.15.136:0/2824370210 conn(0x7f6a980d0c30 msgr2=0x7f6a980d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 -- 172.21.15.136:0/2824370210 shutdown_connections 2024-05-04T07:50:47.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.258+0000 7f6a9ce00640 1 -- 172.21.15.136:0/2824370210 wait complete. 2024-05-04T07:50:47.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.260+0000 7f6a9ce00640 1 Processor -- start 2024-05-04T07:50:47.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.260+0000 7f6a9ce00640 1 -- start start 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9815f190 0x7f6a9815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9814a2a0 0x7f6a980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6a980aedb0 con 0x7f6a980cf960 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a980c65d0 con 0x7f6a9814a2a0 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a9ce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a980cf4d0 con 0x7f6a9815f190 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a95e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a95e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38810/0 (socket says 172.21.15.136:38810) 2024-05-04T07:50:47.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.261+0000 7f6a95e00640 1 -- 172.21.15.136:0/1079502178 learned_addr learned my addr 172.21.15.136:0/1079502178 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a96800640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9814a2a0 0x7f6a980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 -- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9815f190 msgr2=0x7f6a9815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9815f190 0x7f6a9815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 -- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9814a2a0 msgr2=0x7f6a980c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9814a2a0 0x7f6a980c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 -- 172.21.15.136:0/1079502178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9815fde0 con 0x7f6a980cf960 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.262+0000 7f6a95e00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d620 tx=0x7f6a8800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.263+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800b620 con 0x7f6a980cf960 2024-05-04T07:50:47.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.263+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a88019070 con 0x7f6a980cf960 2024-05-04T07:50:47.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.263+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800ba00 con 0x7f6a980cf960 2024-05-04T07:50:47.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.263+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a98162220 con 0x7f6a980cf960 2024-05-04T07:50:47.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.263+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a98161dd0 con 0x7f6a980cf960 2024-05-04T07:50:47.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.264+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980ae870 con 0x7f6a980cf960 2024-05-04T07:50:47.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.265+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a8800bba0 con 0x7f6a980cf960 2024-05-04T07:50:47.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.267+0000 7f6a8e000640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 0x7f6a740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.267+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6a88097e00 con 0x7f6a980cf960 2024-05-04T07:50:47.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.267+0000 7f6a95400640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 0x7f6a740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.268+0000 7f6a95400640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 0x7f6a740787c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a80034000 tx=0x7f6a8002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.273+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a980ae870 con 0x7f6a980cf960 2024-05-04T07:50:47.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.485+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a98069400 con 0x7f6a980cf960 2024-05-04T07:50:47.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.487+0000 7f6a8e000640 1 -- 172.21.15.136:0/1079502178 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f6a88061380 con 0x7f6a980cf960 2024-05-04T07:50:47.488 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:47.488 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:47.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 msgr2=0x7f6a740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 0x7f6a740787c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a80034000 tx=0x7f6a8002c000 comp rx=0 tx=0).stop 2024-05-04T07:50:47.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 msgr2=0x7f6a9815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800d620 tx=0x7f6a8800dae0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 shutdown_connections 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6a74076300 0x7f6a740787c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a9814a2a0 0x7f6a980c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a9815f190 0x7f6a9815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 --2- 172.21.15.136:0/1079502178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a980cf960 0x7f6a9815f750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.490+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 >> 172.21.15.136:0/1079502178 conn(0x7f6a980d0c30 msgr2=0x7f6a980cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.491+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 shutdown_connections 2024-05-04T07:50:47.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.491+0000 7f6a9ce00640 1 -- 172.21.15.136:0/1079502178 wait complete. 2024-05-04T07:50:47.511 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:47.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.711+0000 7f291fa00640 1 Processor -- start 2024-05-04T07:50:47.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.712+0000 7f291fa00640 1 -- start start 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291fa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f2918072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291fa00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f29180c5ab0 0x7f29180c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291fa00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2918146900 con 0x7f291813ff40 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291fa00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2918140320 con 0x7f29180c5ab0 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291fa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2918072890 con 0x7f2918071ef0 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.713+0000 7f291da00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f29180c5ab0 0x7f29180c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f29180c5ab0 0x7f29180c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38812/0 (socket says 172.21.15.136:38812) 2024-05-04T07:50:47.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 -- 172.21.15.136:0/669329074 learned_addr learned my addr 172.21.15.136:0/669329074 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f2917e00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f2918072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 -- 172.21.15.136:0/669329074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 msgr2=0x7f2918072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f2918072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 -- 172.21.15.136:0/669329074 >> v1:172.21.15.142:6789/0 conn(0x7f291813ff40 legacy=0x7f2918145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.714+0000 7f291da00640 1 -- 172.21.15.136:0/669329074 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291815d7f0 con 0x7f29180c5ab0 2024-05-04T07:50:47.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.715+0000 7f291da00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f29180c5f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2900009870 tx=0x7f290002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779d7168248d04a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.715+0000 7f2917400640 1 -- 172.21.15.136:0/669329074 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900037070 con 0x7f29180c5ab0 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.715+0000 7f2917400640 1 -- 172.21.15.136:0/669329074 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900032440 con 0x7f29180c5ab0 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.715+0000 7f2917400640 1 -- 172.21.15.136:0/669329074 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900032810 con 0x7f29180c5ab0 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 -- 172.21.15.136:0/669329074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 msgr2=0x7f29180c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f29180c5f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2900009870 tx=0x7f290002a1c0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 -- 172.21.15.136:0/669329074 shutdown_connections 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f2918072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 --2- 172.21.15.136:0/669329074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f29180c5f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 -- 172.21.15.136:0/669329074 >> 172.21.15.136:0/669329074 conn(0x7f29180d0c30 msgr2=0x7f29180d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 -- 172.21.15.136:0/669329074 shutdown_connections 2024-05-04T07:50:47.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.716+0000 7f291fa00640 1 -- 172.21.15.136:0/669329074 wait complete. 2024-05-04T07:50:47.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.718+0000 7f291fa00640 1 Processor -- start 2024-05-04T07:50:47.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.718+0000 7f291fa00640 1 -- start start 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f29181f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f291813ff40 0x7f2918137210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2918161910 con 0x7f29180c5ab0 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f291815de40 con 0x7f291813ff40 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f291fa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f291815d4a0 con 0x7f2918071ef0 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f2917e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f2917e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38824/0 (socket says 172.21.15.136:38824) 2024-05-04T07:50:47.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.719+0000 7f2917e00640 1 -- 172.21.15.136:0/2368808883 learned_addr learned my addr 172.21.15.136:0/2368808883 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:47.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 -- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 msgr2=0x7f29181f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f29181f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 -- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f291813ff40 msgr2=0x7f2918137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f291813ff40 0x7f2918137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 -- 172.21.15.136:0/2368808883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29181f3010 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2917e00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f290800d800 tx=0x7f290800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800b6c0 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908019070 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2918137aa0 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800ba80 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.720+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2918138060 con 0x7f29180c5ab0 2024-05-04T07:50:47.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.722+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2918069400 con 0x7f29180c5ab0 2024-05-04T07:50:47.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.723+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f290800bc20 con 0x7f29180c5ab0 2024-05-04T07:50:47.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.724+0000 7f2914c00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 0x7f28f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:47.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.724+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2908097f00 con 0x7f29180c5ab0 2024-05-04T07:50:47.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.724+0000 7f291d000640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 0x7f28f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:47.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.725+0000 7f291d000640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 0x7f28f4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f291000ab90 tx=0x7f2910009230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:47.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.729+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f29080613f0 con 0x7f29180c5ab0 2024-05-04T07:50:47.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.939+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29180b39e0 con 0x7f29180c5ab0 2024-05-04T07:50:47.942 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.942+0000 7f2914c00640 1 -- 172.21.15.136:0/2368808883 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f2908060cf0 con 0x7f29180c5ab0 2024-05-04T07:50:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:47.943 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:47.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 msgr2=0x7f28f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 0x7f28f4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f291000ab90 tx=0x7f2910009230 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 msgr2=0x7f2918136cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f290800d800 tx=0x7f290800dcc0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 shutdown_connections 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f28f40762d0 0x7f28f4078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f291813ff40 0x7f2918137210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29180c5ab0 0x7f2918136cd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 --2- 172.21.15.136:0/2368808883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2918071ef0 0x7f29181f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 >> 172.21.15.136:0/2368808883 conn(0x7f29180d0c30 msgr2=0x7f29180b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:47.946 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 shutdown_connections 2024-05-04T07:50:47.947 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:47.945+0000 7f291fa00640 1 -- 172.21.15.136:0/2368808883 wait complete. 2024-05-04T07:50:47.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-04T07:50:48.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.161+0000 7f0b7c800640 1 Processor -- start 2024-05-04T07:50:48.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.161+0000 7f0b7c800640 1 -- start start 2024-05-04T07:50:48.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b7c800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b740d1a50 0x7f0b7415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b7c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740b6140 0x7f0b7415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b7c800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b740d07d0 con 0x7f0b740d1e30 2024-05-04T07:50:48.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b7c800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0b740d0ab0 con 0x7f0b740d1a50 2024-05-04T07:50:48.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b7c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740d0d90 con 0x7f0b740b6140 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b79e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b740d1a50 0x7f0b7415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b79e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b740d1a50 0x7f0b7415f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38838/0 (socket says 172.21.15.136:38838) 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.163+0000 7f0b79e00640 1 -- 172.21.15.136:0/938110423 learned_addr learned my addr 172.21.15.136:0/938110423 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.164+0000 7f0b79400640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740b6140 0x7f0b7415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.164+0000 7f0b79e00640 1 -- 172.21.15.136:0/938110423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740b6140 msgr2=0x7f0b7415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.164+0000 7f0b79e00640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740b6140 0x7f0b7415f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.164+0000 7f0b79e00640 1 -- 172.21.15.136:0/938110423 >> v1:172.21.15.142:6789/0 conn(0x7f0b740d1e30 legacy=0x7f0b740d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.164+0000 7f0b79e00640 1 -- 172.21.15.136:0/938110423 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b740d5eb0 con 0x7f0b740d1a50 2024-05-04T07:50:48.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.165+0000 7f0b79e00640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1a50 0x7f0b7415f190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009870 tx=0x7f0b6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c49abf5a04c5ed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b78a00640 1 -- 172.21.15.136:0/938110423 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68037070 con 0x7f0b740d1a50 2024-05-04T07:50:48.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b78a00640 1 -- 172.21.15.136:0/938110423 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b68032440 con 0x7f0b740d1a50 2024-05-04T07:50:48.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b78a00640 1 -- 172.21.15.136:0/938110423 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68032810 con 0x7f0b740d1a50 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 -- 172.21.15.136:0/938110423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1a50 msgr2=0x7f0b7415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1a50 0x7f0b7415f190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009870 tx=0x7f0b6802a1c0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 -- 172.21.15.136:0/938110423 shutdown_connections 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740b6140 0x7f0b7415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 --2- 172.21.15.136:0/938110423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1a50 0x7f0b7415f190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.166+0000 7f0b7c800640 1 -- 172.21.15.136:0/938110423 >> 172.21.15.136:0/938110423 conn(0x7f0b740d5080 msgr2=0x7f0b740d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:48.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.167+0000 7f0b7c800640 1 -- 172.21.15.136:0/938110423 shutdown_connections 2024-05-04T07:50:48.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.167+0000 7f0b7c800640 1 -- 172.21.15.136:0/938110423 wait complete. 2024-05-04T07:50:48.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.168+0000 7f0b7c800640 1 Processor -- start 2024-05-04T07:50:48.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.168+0000 7f0b7c800640 1 -- start start 2024-05-04T07:50:48.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b740b6140 0x7f0b7414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740d1a50 0x7f0b7414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740b6810 con 0x7f0b740d1e30 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740b6690 con 0x7f0b740b6140 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.169+0000 7f0b7c800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740c9cc0 con 0x7f0b740d1a50 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38854/0 (socket says 172.21.15.136:38854) 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 -- 172.21.15.136:0/1866980815 learned_addr learned my addr 172.21.15.136:0/1866980815 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b79e00640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b740b6140 0x7f0b7414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b79400640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740d1a50 0x7f0b7414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 -- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740d1a50 msgr2=0x7f0b7414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740d1a50 0x7f0b7414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 -- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b740b6140 msgr2=0x7f0b7414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b740b6140 0x7f0b7414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.170+0000 7f0b7a800640 1 -- 172.21.15.136:0/1866980815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7414e780 con 0x7f0b740d1e30 2024-05-04T07:50:48.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b7a800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000b970 tx=0x7f0b7000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70019070 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7000cb40 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70014440 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7414ea60 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.171+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7414f020 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.172+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74069470 con 0x7f0b740d1e30 2024-05-04T07:50:48.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.173+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b7001c070 con 0x7f0b740d1e30 2024-05-04T07:50:48.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.174+0000 7f0b6e000640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 0x7f0b58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.174+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0b70097630 con 0x7f0b740d1e30 2024-05-04T07:50:48.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.175+0000 7f0b79e00640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 0x7f0b58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.175+0000 7f0b79e00640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 0x7f0b58078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.179+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b70060bb0 con 0x7f0b740d1e30 2024-05-04T07:50:48.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.423+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0b7415e790 con 0x7f0b740d1e30 2024-05-04T07:50:48.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.640+0000 7f0b6e000640 1 -- 172.21.15.136:0/1866980815 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f0b700604b0 con 0x7f0b740d1e30 2024-05-04T07:50:48.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 msgr2=0x7f0b58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 0x7f0b58078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802e000 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 msgr2=0x7f0b7414fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000b970 tx=0x7f0b7000be30 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 shutdown_connections 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0b580762d0 0x7f0b58078790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b740d1e30 0x7f0b7414fe40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b740d1a50 0x7f0b7414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 --2- 172.21.15.136:0/1866980815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b740b6140 0x7f0b7414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 >> 172.21.15.136:0/1866980815 conn(0x7f0b740d5080 msgr2=0x7f0b740ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 shutdown_connections 2024-05-04T07:50:48.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.644+0000 7f0b7c800640 1 -- 172.21.15.136:0/1866980815 wait complete. 2024-05-04T07:50:48.668 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-04T07:50:48.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-04T07:50:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.864+0000 7ff447800640 1 Processor -- start 2024-05-04T07:50:48.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.864+0000 7ff447800640 1 -- start start 2024-05-04T07:50:48.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff447800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff44006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff447800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff440072af0 0x7ff440166b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff447800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4400cc2b0 con 0x7ff440073d50 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff447800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff44015df70 con 0x7ff440072af0 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff447800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff44006ff90 con 0x7ff44015ad40 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff43fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff440073d50 0x7ff4400723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41418/0 (socket says 172.21.15.136:41418) 2024-05-04T07:50:48.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.866+0000 7ff43fe00640 1 -- 172.21.15.136:0/1068081894 learned_addr learned my addr 172.21.15.136:0/1068081894 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff445800640 1 --2- 172.21.15.136:0/1068081894 >> v2:172.21.15.142:3300/0 conn(0x7ff440072af0 0x7ff440166b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff444e00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff44006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102111235 0 0) 0x7ff4400cc2b0 con 0x7ff440073d50 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff428003520 con 0x7ff440073d50 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3746319673 0 0) 0x7ff428003520 con 0x7ff440073d50 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 msgr2=0x7ff44006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff44006fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 >> v2:172.21.15.142:3300/0 conn(0x7ff440072af0 msgr2=0x7ff440166b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 --2- 172.21.15.136:0/1068081894 >> v2:172.21.15.142:3300/0 conn(0x7ff440072af0 0x7ff440166b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400701e0 con 0x7ff440073d50 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7ff42c0016f0 con 0x7ff440073d50 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 >> v1:172.21.15.136:6789/0 conn(0x7ff440073d50 legacy=0x7ff4400723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff428003a00 0x7ff428003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff428004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.867+0000 7ff43f400640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff428004d40 0x7ff4280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff44006ff90 con 0x7ff428003a00 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff42800b9c0 con 0x7ff428004d40 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff42800bb70 con 0x7ff44015ad40 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff428003a00 0x7ff428003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff445800640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff428004d40 0x7ff4280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 -- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 msgr2=0x7ff428004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff43fe00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff428004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff44015ad40 0x7ff428004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 -- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff428004d40 msgr2=0x7ff4280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:48.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff428004d40 0x7ff4280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff444e00640 1 -- 172.21.15.136:0/1068081894 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428003520 con 0x7ff428003a00 2024-05-04T07:50:48.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.868+0000 7ff445800640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff428004d40 0x7ff4280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.869+0000 7ff444e00640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff428003a00 0x7ff428003e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff434009ac0 tx=0x7ff428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3644dc40ed805a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.869+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434036070 con 0x7ff428003a00 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.869+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff434031400 con 0x7ff428003a00 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.869+0000 7ff43f400640 1 -- 172.21.15.136:0/1068081894 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434009690 con 0x7ff428003a00 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 -- 172.21.15.136:0/1068081894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff428003a00 msgr2=0x7ff428003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 --2- 172.21.15.136:0/1068081894 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff428003a00 0x7ff428003e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff434009ac0 tx=0x7ff428005830 comp rx=0 tx=0).stop 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff445800640 1 -- 172.21.15.136:0/1068081894 reap_dead start 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 -- 172.21.15.136:0/1068081894 shutdown_connections 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 -- 172.21.15.136:0/1068081894 >> 172.21.15.136:0/1068081894 conn(0x7ff4400d0c50 msgr2=0x7ff4400d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 -- 172.21.15.136:0/1068081894 shutdown_connections 2024-05-04T07:50:48.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.870+0000 7ff447800640 1 -- 172.21.15.136:0/1068081894 wait complete. 2024-05-04T07:50:48.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.872+0000 7ff447800640 1 Processor -- start 2024-05-04T07:50:48.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.872+0000 7ff447800640 1 -- start start 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff428003a00 0x7ff44014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4400b3ac0 0x7ff4400b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff44015dc00 con 0x7ff440154a60 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff44015d920 con 0x7ff4400b3ac0 2024-05-04T07:50:48.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff447800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff4400731a0 con 0x7ff428003a00 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.873+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38872/0 (socket says 172.21.15.136:38872) 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 -- 172.21.15.136:0/1768843929 learned_addr learned my addr 172.21.15.136:0/1768843929 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff445800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4400b3ac0 0x7ff4400b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff444e00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff428003a00 0x7ff44014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 -- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff428003a00 msgr2=0x7ff44014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff428003a00 0x7ff44014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 -- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4400b3ac0 msgr2=0x7ff4400b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4400b3ac0 0x7ff4400b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:48.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 -- 172.21.15.136:0/1768843929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400b4890 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43fe00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d7e0 tx=0x7ff42c00dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.874+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c019070 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.875+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c0074e0 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.875+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c004a00 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.875+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4400b4b70 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.875+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4400b5130 con 0x7ff440154a60 2024-05-04T07:50:48.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.876+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff440069470 con 0x7ff440154a60 2024-05-04T07:50:48.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.877+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff42c01c070 con 0x7ff440154a60 2024-05-04T07:50:48.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.878+0000 7ff43cc00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 0x7ff4200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:48.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.878+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff42c0971f0 con 0x7ff440154a60 2024-05-04T07:50:48.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.878+0000 7ff444e00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 0x7ff4200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:48.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.879+0000 7ff444e00640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 0x7ff4200787c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff434033000 tx=0x7ff434008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:48.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:48.882+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff42c0601c0 con 0x7ff440154a60 2024-05-04T07:50:49.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.128+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff4400d17d0 con 0x7ff440154a60 2024-05-04T07:50:49.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.644+0000 7ff43cc00640 1 -- 172.21.15.136:0/1768843929 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7ff42c0644c0 con 0x7ff440154a60 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 msgr2=0x7ff4200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 0x7ff4200787c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff434033000 tx=0x7ff434008030 comp rx=0 tx=0).stop 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 msgr2=0x7ff440154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00d7e0 tx=0x7ff42c00dca0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 shutdown_connections 2024-05-04T07:50:49.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff420076300 0x7ff4200787c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4400b3ac0 0x7ff4400b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff440154a60 0x7ff440154ee0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 --2- 172.21.15.136:0/1768843929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff428003a00 0x7ff44014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.647+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 >> 172.21.15.136:0/1768843929 conn(0x7ff4400d0c50 msgr2=0x7ff44015e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.648+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 shutdown_connections 2024-05-04T07:50:49.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.648+0000 7ff447800640 1 -- 172.21.15.136:0/1768843929 wait complete. 2024-05-04T07:50:49.670 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-04T07:50:49.670 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.868+0000 7f81c9400640 1 Processor -- start 2024-05-04T07:50:49.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.868+0000 7f81c9400640 1 -- start start 2024-05-04T07:50:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.869+0000 7f81c9400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81c413ff40 0x7f81c4145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.869+0000 7f81c9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 0x7f81c4071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c9400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c4146900 con 0x7f81c4072430 2024-05-04T07:50:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c9400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f81c4140320 con 0x7f81c413ff40 2024-05-04T07:50:49.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f81c415de40 con 0x7f81c41463a0 2024-05-04T07:50:49.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c2800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81c413ff40 0x7f81c4145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:49.871 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c3200640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f81c4072430 0x7f81c4142640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41424/0 (socket says 172.21.15.136:41424) 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c3200640 1 -- 172.21.15.136:0/1937754925 learned_addr learned my addr 172.21.15.136:0/1937754925 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c2800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f81c413ff40 0x7f81c4145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38876/0 (socket says 172.21.15.136:38876) 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c2800640 1 -- 172.21.15.136:0/1937754925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 msgr2=0x7f81c4071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.870+0000 7f81c1e00640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 0x7f81c4071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.871+0000 7f81c2800640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 0x7f81c4071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.871+0000 7f81c2800640 1 -- 172.21.15.136:0/1937754925 >> v1:172.21.15.136:6789/0 conn(0x7f81c4072430 legacy=0x7f81c4142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.871+0000 7f81c2800640 1 -- 172.21.15.136:0/1937754925 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c415d7f0 con 0x7f81c413ff40 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.871+0000 7f81c1e00640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 0x7f81c4071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:49.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.871+0000 7f81c1400640 1 -- 172.21.15.136:0/1937754925 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3798431040 0 0) 0x7f81c4146900 con 0x7f81c4072430 2024-05-04T07:50:49.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c2800640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c413ff40 0x7f81c4145e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8376505f8b566c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:49.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c1400640 1 -- 172.21.15.136:0/1937754925 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4037070 con 0x7f81c413ff40 2024-05-04T07:50:49.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c1400640 1 -- 172.21.15.136:0/1937754925 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b4032440 con 0x7f81c413ff40 2024-05-04T07:50:49.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c1400640 1 -- 172.21.15.136:0/1937754925 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4032810 con 0x7f81c413ff40 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c9400640 1 -- 172.21.15.136:0/1937754925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c413ff40 msgr2=0x7f81c4145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.872+0000 7f81c9400640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c413ff40 0x7f81c4145e60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402a180 comp rx=0 tx=0).stop 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 -- 172.21.15.136:0/1937754925 shutdown_connections 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c41463a0 0x7f81c4071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 --2- 172.21.15.136:0/1937754925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c413ff40 0x7f81c4145e60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 -- 172.21.15.136:0/1937754925 >> 172.21.15.136:0/1937754925 conn(0x7f81c40d0c30 msgr2=0x7f81c40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 -- 172.21.15.136:0/1937754925 shutdown_connections 2024-05-04T07:50:49.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.873+0000 7f81c9400640 1 -- 172.21.15.136:0/1937754925 wait complete. 2024-05-04T07:50:49.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.874+0000 7f81c9400640 1 Processor -- start 2024-05-04T07:50:49.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 -- start start 2024-05-04T07:50:49.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c413ff40 0x7f81c40b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c41463a0 0x7f81c40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4161910 con 0x7f81c4072430 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81c40c6ac0 con 0x7f81c41463a0 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.875+0000 7f81c9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f81c415d4a0 con 0x7f81c413ff40 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38882/0 (socket says 172.21.15.136:38882) 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 -- 172.21.15.136:0/1945632038 learned_addr learned my addr 172.21.15.136:0/1945632038 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 -- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c413ff40 msgr2=0x7f81c40b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c413ff40 0x7f81c40b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 -- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c41463a0 msgr2=0x7f81c40cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c41463a0 0x7f81c40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 -- 172.21.15.136:0/1945632038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c415a7e0 con 0x7f81c4072430 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.876+0000 7f81c2800640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.877+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4037050 con 0x7f81c4072430 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.877+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b4038040 con 0x7f81c4072430 2024-05-04T07:50:49.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.877+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004490 con 0x7f81c4072430 2024-05-04T07:50:49.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.877+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c40b3e60 con 0x7f81c4072430 2024-05-04T07:50:49.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.877+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c40b4420 con 0x7f81c4072430 2024-05-04T07:50:49.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.878+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c4069400 con 0x7f81c4072430 2024-05-04T07:50:49.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.879+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81b4030980 con 0x7f81c4072430 2024-05-04T07:50:49.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.880+0000 7f81baa00640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 0x7f81a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:49.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.880+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f81b40b85a0 con 0x7f81c4072430 2024-05-04T07:50:49.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.881+0000 7f81c1e00640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 0x7f81a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:49.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.881+0000 7f81c1e00640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 0x7f81a4078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006fd0 tx=0x7f81b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:49.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:49.885+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f81b4081b20 con 0x7f81c4072430 2024-05-04T07:50:50.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.137+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c4160300 con 0x7f81c4072430 2024-05-04T07:50:50.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.138+0000 7f81baa00640 1 -- 172.21.15.136:0/1945632038 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f81b4081420 con 0x7f81c4072430 2024-05-04T07:50:50.139 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:50.139 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:50.139 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 msgr2=0x7f81a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 0x7f81a4078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006fd0 tx=0x7f81b0008040 comp rx=0 tx=0).stop 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 msgr2=0x7f81c415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b40046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 shutdown_connections 2024-05-04T07:50:50.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f81a40762d0 0x7f81a4078790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c41463a0 0x7f81c40cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81c413ff40 0x7f81c40b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 --2- 172.21.15.136:0/1945632038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81c4072430 0x7f81c415a2a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.141+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 >> 172.21.15.136:0/1945632038 conn(0x7f81c40d0c30 msgr2=0x7f81c4160890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.142+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 shutdown_connections 2024-05-04T07:50:50.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.142+0000 7f81c9400640 1 -- 172.21.15.136:0/1945632038 wait complete. 2024-05-04T07:50:50.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:50.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.356+0000 7f7b77200640 1 Processor -- start 2024-05-04T07:50:50.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.356+0000 7f7b77200640 1 -- start start 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b77200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7006dce0 0x7f7b700ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b77200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7b7015f510 0x7f7b7006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b77200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7006e600 con 0x7f7b700cc9c0 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b77200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7b700d1970 con 0x7f7b7015f510 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b77200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700d1690 con 0x7f7b7006dce0 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7b7015f510 0x7f7b7006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7b7015f510 0x7f7b7006e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38888/0 (socket says 172.21.15.136:38888) 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75400640 1 -- 172.21.15.136:0/3389236322 learned_addr learned my addr 172.21.15.136:0/3389236322 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:50.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75e00640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7006dce0 0x7f7b700ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75400640 1 -- 172.21.15.136:0/3389236322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7006dce0 msgr2=0x7f7b700ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.358+0000 7f7b75400640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7006dce0 0x7f7b700ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.359+0000 7f7b75400640 1 -- 172.21.15.136:0/3389236322 >> v1:172.21.15.142:6789/0 conn(0x7f7b700cc9c0 legacy=0x7f7b700ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.359+0000 7f7b75400640 1 -- 172.21.15.136:0/3389236322 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700cbd80 con 0x7f7b7015f510 2024-05-04T07:50:50.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.360+0000 7f7b75400640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7015f510 0x7f7b7006e0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009870 tx=0x7f7b6002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58c9535eb24b38 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.360+0000 7f7b74a00640 1 -- 172.21.15.136:0/3389236322 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60037070 con 0x7f7b7015f510 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.360+0000 7f7b74a00640 1 -- 172.21.15.136:0/3389236322 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b60032440 con 0x7f7b7015f510 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.360+0000 7f7b74a00640 1 -- 172.21.15.136:0/3389236322 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60032810 con 0x7f7b7015f510 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 -- 172.21.15.136:0/3389236322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7015f510 msgr2=0x7f7b7006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7015f510 0x7f7b7006e0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009870 tx=0x7f7b6002a250 comp rx=0 tx=0).stop 2024-05-04T07:50:50.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 -- 172.21.15.136:0/3389236322 shutdown_connections 2024-05-04T07:50:50.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7015f510 0x7f7b7006e0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 --2- 172.21.15.136:0/3389236322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b7006dce0 0x7f7b700ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 -- 172.21.15.136:0/3389236322 >> 172.21.15.136:0/3389236322 conn(0x7f7b700d09d0 msgr2=0x7f7b700d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:50.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 -- 172.21.15.136:0/3389236322 shutdown_connections 2024-05-04T07:50:50.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.361+0000 7f7b77200640 1 -- 172.21.15.136:0/3389236322 wait complete. 2024-05-04T07:50:50.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.363+0000 7f7b77200640 1 Processor -- start 2024-05-04T07:50:50.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.363+0000 7f7b77200640 1 -- start start 2024-05-04T07:50:50.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b700cc9c0 0x7f7b701f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7015f510 0x7f7b701f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700af890 con 0x7f7b7006dce0 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700cc340 con 0x7f7b7015f510 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b77200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700afa10 con 0x7f7b700cc9c0 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b75e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b75e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38892/0 (socket says 172.21.15.136:38892) 2024-05-04T07:50:50.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.364+0000 7f7b75e00640 1 -- 172.21.15.136:0/3749161889 learned_addr learned my addr 172.21.15.136:0/3749161889 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 -- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b700cc9c0 msgr2=0x7f7b701f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b700cc9c0 0x7f7b701f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 -- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7015f510 msgr2=0x7f7b701f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7015f510 0x7f7b701f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 -- 172.21.15.136:0/3749161889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700c8a90 con 0x7f7b7006dce0 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b75e00640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c7f0 tx=0x7f7b6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64015070 con 0x7f7b7006dce0 2024-05-04T07:50:50.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64004220 con 0x7f7b7006dce0 2024-05-04T07:50:50.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003610 con 0x7f7b7006dce0 2024-05-04T07:50:50.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.365+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b700c8d70 con 0x7f7b7006dce0 2024-05-04T07:50:50.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.366+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b700b39f0 con 0x7f7b7006dce0 2024-05-04T07:50:50.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.367+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b70069400 con 0x7f7b7006dce0 2024-05-04T07:50:50.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.368+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b640039c0 con 0x7f7b7006dce0 2024-05-04T07:50:50.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.369+0000 7f7b6a000640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 0x7f7b540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.369+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7b64097930 con 0x7f7b7006dce0 2024-05-04T07:50:50.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.369+0000 7f7b75400640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 0x7f7b540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.370+0000 7f7b75400640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 0x7f7b540787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b60034000 tx=0x7f7b6002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.374+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b64060f50 con 0x7f7b7006dce0 2024-05-04T07:50:50.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.586+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b700aee00 con 0x7f7b7006dce0 2024-05-04T07:50:50.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.589+0000 7f7b6a000640 1 -- 172.21.15.136:0/3749161889 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f7b64060850 con 0x7f7b7006dce0 2024-05-04T07:50:50.590 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:50.590 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.591+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 msgr2=0x7f7b540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.591+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 0x7f7b540787c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b60034000 tx=0x7f7b6002c000 comp rx=0 tx=0).stop 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.591+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 msgr2=0x7f7b700c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.591+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c7f0 tx=0x7f7b6400ccb0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.591+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 shutdown_connections 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7b54076300 0x7f7b540787c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b7015f510 0x7f7b701f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b700cc9c0 0x7f7b701f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 --2- 172.21.15.136:0/3749161889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b7006dce0 0x7f7b700c84b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 >> 172.21.15.136:0/3749161889 conn(0x7f7b700d09d0 msgr2=0x7f7b70071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:50.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 shutdown_connections 2024-05-04T07:50:50.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.592+0000 7f7b77200640 1 -- 172.21.15.136:0/3749161889 wait complete. 2024-05-04T07:50:50.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T07:50:50.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:50:50.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.812+0000 7f39b0800640 1 Processor -- start 2024-05-04T07:50:50.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.812+0000 7f39b0800640 1 -- start start 2024-05-04T07:50:50.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39b0800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 0x7f39a80cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39b0800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39a80cf960 0x7f39a80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39b0800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a815f570 con 0x7f39a80cc6f0 2024-05-04T07:50:50.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39b0800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f39a80c6940 con 0x7f39a80cf960 2024-05-04T07:50:50.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39b0800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f39a80ccb80 con 0x7f39a815f190 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39ae800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39a80cf960 0x7f39a80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39ae800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39a80cf960 0x7f39a80cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38902/0 (socket says 172.21.15.136:38902) 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.814+0000 7f39ae800640 1 -- 172.21.15.136:0/1238877938 learned_addr learned my addr 172.21.15.136:0/1238877938 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ade00640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 0x7f39a80cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ae800640 1 -- 172.21.15.136:0/1238877938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 msgr2=0x7f39a80cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ae800640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 0x7f39a80cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ae800640 1 -- 172.21.15.136:0/1238877938 >> v1:172.21.15.142:6789/0 conn(0x7f39a80cc6f0 legacy=0x7f39a80ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ae800640 1 -- 172.21.15.136:0/1238877938 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a80c6010 con 0x7f39a80cf960 2024-05-04T07:50:50.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.815+0000 7f39ade00640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 0x7f39a80cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:50.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.816+0000 7f39ae800640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a80cf960 0x7f39a80cedc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009e50 tx=0x7f39a402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c45109f8379d1d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.816+0000 7f39aca00640 1 -- 172.21.15.136:0/1238877938 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4036070 con 0x7f39a80cf960 2024-05-04T07:50:50.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.816+0000 7f39aca00640 1 -- 172.21.15.136:0/1238877938 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4031600 con 0x7f39a80cf960 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.816+0000 7f39aca00640 1 -- 172.21.15.136:0/1238877938 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40319d0 con 0x7f39a80cf960 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 -- 172.21.15.136:0/1238877938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a80cf960 msgr2=0x7f39a80cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a80cf960 0x7f39a80cedc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009e50 tx=0x7f39a402a680 comp rx=0 tx=0).stop 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 -- 172.21.15.136:0/1238877938 shutdown_connections 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a80cf960 0x7f39a80cedc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 --2- 172.21.15.136:0/1238877938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a815f190 0x7f39a80cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 -- 172.21.15.136:0/1238877938 >> 172.21.15.136:0/1238877938 conn(0x7f39a80d0c30 msgr2=0x7f39a80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 -- 172.21.15.136:0/1238877938 shutdown_connections 2024-05-04T07:50:50.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.817+0000 7f39b0800640 1 -- 172.21.15.136:0/1238877938 wait complete. 2024-05-04T07:50:50.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.819+0000 7f39b0800640 1 Processor -- start 2024-05-04T07:50:50.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.819+0000 7f39b0800640 1 -- start start 2024-05-04T07:50:50.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a80cf960 0x7f39a806e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a81f8450 0x7f39a80b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f39a80cf300 con 0x7f39a815f190 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f39a80c65d0 con 0x7f39a81f8450 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39b0800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f39a80cf480 con 0x7f39a80cf960 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39ad400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39ad400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38904/0 (socket says 172.21.15.136:38904) 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39ad400640 1 -- 172.21.15.136:0/1133089905 learned_addr learned my addr 172.21.15.136:0/1133089905 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39ade00640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a80cf960 0x7f39a806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.820+0000 7f39ae800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a81f8450 0x7f39a80b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 -- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a80cf960 msgr2=0x7f39a806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a80cf960 0x7f39a806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 -- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a81f8450 msgr2=0x7f39a80b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a81f8450 0x7f39a80b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 -- 172.21.15.136:0/1133089905 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a806ec60 con 0x7f39a815f190 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39ad400640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f399800c460 tx=0x7f399800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998016020 con 0x7f39a815f190 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3998012870 con 0x7f39a815f190 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998012c60 con 0x7f39a815f190 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a806ef40 con 0x7f39a815f190 2024-05-04T07:50:50.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.821+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a806f500 con 0x7f39a815f190 2024-05-04T07:50:50.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.822+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a8069400 con 0x7f39a815f190 2024-05-04T07:50:50.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.824+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3998019020 con 0x7f39a815f190 2024-05-04T07:50:50.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.825+0000 7f39a2000640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 0x7f398c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:50.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.825+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3998097670 con 0x7f39a815f190 2024-05-04T07:50:50.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.825+0000 7f39ade00640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 0x7f398c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:50.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.826+0000 7f39ade00640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 0x7f398c078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f399c00a950 tx=0x7f399c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:50.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:50.830+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3998020030 con 0x7f39a815f190 2024-05-04T07:50:51.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.032+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39a815cc60 con 0x7f398c0762d0 2024-05-04T07:50:51.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.050+0000 7f39a2000640 1 -- 172.21.15.136:0/1133089905 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332559 (secure 0 0 0) 0x7f39a815cc60 con 0x7f398c0762d0 2024-05-04T07:50:51.057 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:51.059 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:50:51.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.057+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 msgr2=0x7f398c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.057+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 0x7f398c078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f399c00a950 tx=0x7f399c008040 comp rx=0 tx=0).stop 2024-05-04T07:50:51.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.057+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 msgr2=0x7f39a80b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.057+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f399800c460 tx=0x7f399800c920 comp rx=0 tx=0).stop 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 shutdown_connections 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f398c0762d0 0x7f398c078790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a81f8450 0x7f39a80b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39a815f190 0x7f39a80b5d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 --2- 172.21.15.136:0/1133089905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a80cf960 0x7f39a806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 >> 172.21.15.136:0/1133089905 conn(0x7f39a80d0c30 msgr2=0x7f39a815d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 shutdown_connections 2024-05-04T07:50:51.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.058+0000 7f39b0800640 1 -- 172.21.15.136:0/1133089905 wait complete. 2024-05-04T07:50:51.078 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-05-04T07:50:49.277869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004951"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908156+0000","last_change":"2024-05-04T07:50:26.511444+0000","last_active":"2024-05-04T07:50:34.908156+0000","last_peered":"2024-05-04T07:50:34.908156+0000","last_clean":"2024-05-04T07:50:34.908156+0000","last_became_active":"2024-05-04T07:50:26.511184+0000","last_became_peered":"2024-05-04T07:50:26.511184+0000","last_unstale":"2024-05-04T07:50:34.908156+0000","last_undegraded":"2024-05-04T07:50:34.908156+0000","last_fullsized":"2024-05-04T07:50:34.908156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885131+0000","last_change":"2024-05-04T07:50:27.511810+0000","last_active":"2024-05-04T07:50:34.885131+0000","last_peered":"2024-05-04T07:50:34.885131+0000","last_clean":"2024-05-04T07:50:34.885131+0000","last_became_active":"2024-05-04T07:50:27.511405+0000","last_became_peered":"2024-05-04T07:50:27.511405+0000","last_unstale":"2024-05-04T07:50:34.885131+0000","last_undegraded":"2024-05-04T07:50:34.885131+0000","last_fullsized":"2024-05-04T07:50:34.885131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883149+0000","last_change":"2024-05-04T07:50:31.757139+0000","last_active":"2024-05-04T07:50:34.883149+0000","last_peered":"2024-05-04T07:50:34.883149+0000","last_clean":"2024-05-04T07:50:34.883149+0000","last_became_active":"2024-05-04T07:50:31.756650+0000","last_became_peered":"2024-05-04T07:50:31.756650+0000","last_unstale":"2024-05-04T07:50:34.883149+0000","last_undegraded":"2024-05-04T07:50:34.883149+0000","last_fullsized":"2024-05-04T07:50:34.883149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885411+0000","last_change":"2024-05-04T07:50:26.515716+0000","last_active":"2024-05-04T07:50:34.885411+0000","last_peered":"2024-05-04T07:50:34.885411+0000","last_clean":"2024-05-04T07:50:34.885411+0000","last_became_active":"2024-05-04T07:50:26.515369+0000","last_became_peered":"2024-05-04T07:50:26.515369+0000","last_unstale":"2024-05-04T07:50:34.885411+0000","last_undegraded":"2024-05-04T07:50:34.885411+0000","last_fullsized":"2024-05-04T07:50:34.885411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907863+0000","last_change":"2024-05-04T07:50:27.532568+0000","last_active":"2024-05-04T07:50:34.907863+0000","last_peered":"2024-05-04T07:50:34.907863+0000","last_clean":"2024-05-04T07:50:34.907863+0000","last_became_active":"2024-05-04T07:50:27.532259+0000","last_became_peered":"2024-05-04T07:50:27.532259+0000","last_unstale":"2024-05-04T07:50:34.907863+0000","last_undegraded":"2024-05-04T07:50:34.907863+0000","last_fullsized":"2024-05-04T07:50:34.907863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574294+0000","last_change":"2024-05-04T07:50:31.571444+0000","last_active":"2024-05-04T07:50:32.574294+0000","last_peered":"2024-05-04T07:50:32.574294+0000","last_clean":"2024-05-04T07:50:32.574294+0000","last_became_active":"2024-05-04T07:50:31.570161+0000","last_became_peered":"2024-05-04T07:50:31.570161+0000","last_unstale":"2024-05-04T07:50:32.574294+0000","last_undegraded":"2024-05-04T07:50:32.574294+0000","last_fullsized":"2024-05-04T07:50:32.574294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:20.105139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.520446+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.519707+0000","last_became_peered":"2024-05-04T07:50:26.519707+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:04:46.769896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431704+0000","last_change":"2024-05-04T07:50:27.531288+0000","last_active":"2024-05-04T07:50:34.431704+0000","last_peered":"2024-05-04T07:50:34.431704+0000","last_clean":"2024-05-04T07:50:34.431704+0000","last_became_active":"2024-05-04T07:50:27.531005+0000","last_became_peered":"2024-05-04T07:50:27.531005+0000","last_unstale":"2024-05-04T07:50:34.431704+0000","last_undegraded":"2024-05-04T07:50:34.431704+0000","last_fullsized":"2024-05-04T07:50:34.431704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575189+0000","last_change":"2024-05-04T07:50:31.568998+0000","last_active":"2024-05-04T07:50:32.575189+0000","last_peered":"2024-05-04T07:50:32.575189+0000","last_clean":"2024-05-04T07:50:32.575189+0000","last_became_active":"2024-05-04T07:50:31.568443+0000","last_became_peered":"2024-05-04T07:50:31.568443+0000","last_unstale":"2024-05-04T07:50:32.575189+0000","last_undegraded":"2024-05-04T07:50:32.575189+0000","last_fullsized":"2024-05-04T07:50:32.575189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:11.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675279+0000","last_change":"2024-05-04T07:50:26.523596+0000","last_active":"2024-05-04T07:50:34.675279+0000","last_peered":"2024-05-04T07:50:34.675279+0000","last_clean":"2024-05-04T07:50:34.675279+0000","last_became_active":"2024-05-04T07:50:26.523247+0000","last_became_peered":"2024-05-04T07:50:26.523247+0000","last_unstale":"2024-05-04T07:50:34.675279+0000","last_undegraded":"2024-05-04T07:50:34.675279+0000","last_fullsized":"2024-05-04T07:50:34.675279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431910+0000","last_change":"2024-05-04T07:50:27.527272+0000","last_active":"2024-05-04T07:50:34.431910+0000","last_peered":"2024-05-04T07:50:34.431910+0000","last_clean":"2024-05-04T07:50:34.431910+0000","last_became_active":"2024-05-04T07:50:27.526746+0000","last_became_peered":"2024-05-04T07:50:27.526746+0000","last_unstale":"2024-05-04T07:50:34.431910+0000","last_undegraded":"2024-05-04T07:50:34.431910+0000","last_fullsized":"2024-05-04T07:50:34.431910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574307+0000","last_change":"2024-05-04T07:50:31.557824+0000","last_active":"2024-05-04T07:50:32.574307+0000","last_peered":"2024-05-04T07:50:32.574307+0000","last_clean":"2024-05-04T07:50:32.574307+0000","last_became_active":"2024-05-04T07:50:31.557272+0000","last_became_peered":"2024-05-04T07:50:31.557272+0000","last_unstale":"2024-05-04T07:50:32.574307+0000","last_undegraded":"2024-05-04T07:50:32.574307+0000","last_fullsized":"2024-05-04T07:50:32.574307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:15.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574756+0000","last_change":"2024-05-04T07:50:27.530293+0000","last_active":"2024-05-04T07:50:32.574756+0000","last_peered":"2024-05-04T07:50:32.574756+0000","last_clean":"2024-05-04T07:50:32.574756+0000","last_became_active":"2024-05-04T07:50:27.529984+0000","last_became_peered":"2024-05-04T07:50:27.529984+0000","last_unstale":"2024-05-04T07:50:32.574756+0000","last_undegraded":"2024-05-04T07:50:32.574756+0000","last_fullsized":"2024-05-04T07:50:32.574756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.521571+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.521188+0000","last_became_peered":"2024-05-04T07:50:26.521188+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:11.871066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576679+0000","last_change":"2024-05-04T07:50:31.570676+0000","last_active":"2024-05-04T07:50:32.576679+0000","last_peered":"2024-05-04T07:50:32.576679+0000","last_clean":"2024-05-04T07:50:32.576679+0000","last_became_active":"2024-05-04T07:50:31.570276+0000","last_became_peered":"2024-05-04T07:50:31.570276+0000","last_unstale":"2024-05-04T07:50:32.576679+0000","last_undegraded":"2024-05-04T07:50:32.576679+0000","last_fullsized":"2024-05-04T07:50:32.576679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884190+0000","last_change":"2024-05-04T07:50:27.532074+0000","last_active":"2024-05-04T07:50:34.884190+0000","last_peered":"2024-05-04T07:50:34.884190+0000","last_clean":"2024-05-04T07:50:34.884190+0000","last_became_active":"2024-05-04T07:50:27.529720+0000","last_became_peered":"2024-05-04T07:50:27.529720+0000","last_unstale":"2024-05-04T07:50:34.884190+0000","last_undegraded":"2024-05-04T07:50:34.884190+0000","last_fullsized":"2024-05-04T07:50:34.884190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706867+0000","last_change":"2024-05-04T07:50:26.523351+0000","last_active":"2024-05-04T07:50:34.706867+0000","last_peered":"2024-05-04T07:50:34.706867+0000","last_clean":"2024-05-04T07:50:34.706867+0000","last_became_active":"2024-05-04T07:50:26.522661+0000","last_became_peered":"2024-05-04T07:50:26.522661+0000","last_unstale":"2024-05-04T07:50:34.706867+0000","last_undegraded":"2024-05-04T07:50:34.706867+0000","last_fullsized":"2024-05-04T07:50:34.706867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574356+0000","last_change":"2024-05-04T07:50:31.569229+0000","last_active":"2024-05-04T07:50:32.574356+0000","last_peered":"2024-05-04T07:50:32.574356+0000","last_clean":"2024-05-04T07:50:32.574356+0000","last_became_active":"2024-05-04T07:50:31.568499+0000","last_became_peered":"2024-05-04T07:50:31.568499+0000","last_unstale":"2024-05-04T07:50:32.574356+0000","last_undegraded":"2024-05-04T07:50:32.574356+0000","last_fullsized":"2024-05-04T07:50:32.574356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:01.830913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883443+0000","last_change":"2024-05-04T07:50:27.528537+0000","last_active":"2024-05-04T07:50:34.883443+0000","last_peered":"2024-05-04T07:50:34.883443+0000","last_clean":"2024-05-04T07:50:34.883443+0000","last_became_active":"2024-05-04T07:50:27.528071+0000","last_became_peered":"2024-05-04T07:50:27.528071+0000","last_unstale":"2024-05-04T07:50:34.883443+0000","last_undegraded":"2024-05-04T07:50:34.883443+0000","last_fullsized":"2024-05-04T07:50:34.883443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705613+0000","last_change":"2024-05-04T07:50:26.509143+0000","last_active":"2024-05-04T07:50:34.705613+0000","last_peered":"2024-05-04T07:50:34.705613+0000","last_clean":"2024-05-04T07:50:34.705613+0000","last_became_active":"2024-05-04T07:50:26.508476+0000","last_became_peered":"2024-05-04T07:50:26.508476+0000","last_unstale":"2024-05-04T07:50:34.705613+0000","last_undegraded":"2024-05-04T07:50:34.705613+0000","last_fullsized":"2024-05-04T07:50:34.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707315+0000","last_change":"2024-05-04T07:50:31.751464+0000","last_active":"2024-05-04T07:50:34.707315+0000","last_peered":"2024-05-04T07:50:34.707315+0000","last_clean":"2024-05-04T07:50:34.707315+0000","last_became_active":"2024-05-04T07:50:31.751012+0000","last_became_peered":"2024-05-04T07:50:31.751012+0000","last_unstale":"2024-05-04T07:50:34.707315+0000","last_undegraded":"2024-05-04T07:50:34.707315+0000","last_fullsized":"2024-05-04T07:50:34.707315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576462+0000","last_change":"2024-05-04T07:50:27.503181+0000","last_active":"2024-05-04T07:50:32.576462+0000","last_peered":"2024-05-04T07:50:32.576462+0000","last_clean":"2024-05-04T07:50:32.576462+0000","last_became_active":"2024-05-04T07:50:27.502878+0000","last_became_peered":"2024-05-04T07:50:27.502878+0000","last_unstale":"2024-05-04T07:50:32.576462+0000","last_undegraded":"2024-05-04T07:50:32.576462+0000","last_fullsized":"2024-05-04T07:50:32.576462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:33.061709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675823+0000","last_change":"2024-05-04T07:50:26.516424+0000","last_active":"2024-05-04T07:50:34.675823+0000","last_peered":"2024-05-04T07:50:34.675823+0000","last_clean":"2024-05-04T07:50:34.675823+0000","last_became_active":"2024-05-04T07:50:26.515804+0000","last_became_peered":"2024-05-04T07:50:26.515804+0000","last_unstale":"2024-05-04T07:50:34.675823+0000","last_undegraded":"2024-05-04T07:50:34.675823+0000","last_fullsized":"2024-05-04T07:50:34.675823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576592+0000","last_change":"2024-05-04T07:50:31.571745+0000","last_active":"2024-05-04T07:50:32.576592+0000","last_peered":"2024-05-04T07:50:32.576592+0000","last_clean":"2024-05-04T07:50:32.576592+0000","last_became_active":"2024-05-04T07:50:31.571236+0000","last_became_peered":"2024-05-04T07:50:31.571236+0000","last_unstale":"2024-05-04T07:50:32.576592+0000","last_undegraded":"2024-05-04T07:50:32.576592+0000","last_fullsized":"2024-05-04T07:50:32.576592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907548+0000","last_change":"2024-05-04T07:50:27.520723+0000","last_active":"2024-05-04T07:50:34.907548+0000","last_peered":"2024-05-04T07:50:34.907548+0000","last_clean":"2024-05-04T07:50:34.907548+0000","last_became_active":"2024-05-04T07:50:27.520401+0000","last_became_peered":"2024-05-04T07:50:27.520401+0000","last_unstale":"2024-05-04T07:50:34.907548+0000","last_undegraded":"2024-05-04T07:50:34.907548+0000","last_fullsized":"2024-05-04T07:50:34.907548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577779+0000","last_change":"2024-05-04T07:50:26.508044+0000","last_active":"2024-05-04T07:50:32.577779+0000","last_peered":"2024-05-04T07:50:32.577779+0000","last_clean":"2024-05-04T07:50:32.577779+0000","last_became_active":"2024-05-04T07:50:26.507669+0000","last_became_peered":"2024-05-04T07:50:26.507669+0000","last_unstale":"2024-05-04T07:50:32.577779+0000","last_undegraded":"2024-05-04T07:50:32.577779+0000","last_fullsized":"2024-05-04T07:50:32.577779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576003+0000","last_change":"2024-05-04T07:50:31.751252+0000","last_active":"2024-05-04T07:50:32.576003+0000","last_peered":"2024-05-04T07:50:32.576003+0000","last_clean":"2024-05-04T07:50:32.576003+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:32.576003+0000","last_undegraded":"2024-05-04T07:50:32.576003+0000","last_fullsized":"2024-05-04T07:50:32.576003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885325+0000","last_change":"2024-05-04T07:50:27.529761+0000","last_active":"2024-05-04T07:50:34.885325+0000","last_peered":"2024-05-04T07:50:34.885325+0000","last_clean":"2024-05-04T07:50:34.885325+0000","last_became_active":"2024-05-04T07:50:27.529312+0000","last_became_peered":"2024-05-04T07:50:27.529312+0000","last_unstale":"2024-05-04T07:50:34.885325+0000","last_undegraded":"2024-05-04T07:50:34.885325+0000","last_fullsized":"2024-05-04T07:50:34.885325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705096+0000","last_change":"2024-05-04T07:50:26.510946+0000","last_active":"2024-05-04T07:50:34.705096+0000","last_peered":"2024-05-04T07:50:34.705096+0000","last_clean":"2024-05-04T07:50:34.705096+0000","last_became_active":"2024-05-04T07:50:26.510126+0000","last_became_peered":"2024-05-04T07:50:26.510126+0000","last_unstale":"2024-05-04T07:50:34.705096+0000","last_undegraded":"2024-05-04T07:50:34.705096+0000","last_fullsized":"2024-05-04T07:50:34.705096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882789+0000","last_change":"2024-05-04T07:50:31.748699+0000","last_active":"2024-05-04T07:50:34.882789+0000","last_peered":"2024-05-04T07:50:34.882789+0000","last_clean":"2024-05-04T07:50:34.882789+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:34.882789+0000","last_undegraded":"2024-05-04T07:50:34.882789+0000","last_fullsized":"2024-05-04T07:50:34.882789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706580+0000","last_change":"2024-05-04T07:50:27.517196+0000","last_active":"2024-05-04T07:50:34.706580+0000","last_peered":"2024-05-04T07:50:34.706580+0000","last_clean":"2024-05-04T07:50:34.706580+0000","last_became_active":"2024-05-04T07:50:27.516775+0000","last_became_peered":"2024-05-04T07:50:27.516775+0000","last_unstale":"2024-05-04T07:50:34.706580+0000","last_undegraded":"2024-05-04T07:50:34.706580+0000","last_fullsized":"2024-05-04T07:50:34.706580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677514+0000","last_change":"2024-05-04T07:50:26.522492+0000","last_active":"2024-05-04T07:50:34.677514+0000","last_peered":"2024-05-04T07:50:34.677514+0000","last_clean":"2024-05-04T07:50:34.677514+0000","last_became_active":"2024-05-04T07:50:26.522237+0000","last_became_peered":"2024-05-04T07:50:26.522237+0000","last_unstale":"2024-05-04T07:50:34.677514+0000","last_undegraded":"2024-05-04T07:50:34.677514+0000","last_fullsized":"2024-05-04T07:50:34.677514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:49:19.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907032+0000","last_change":"2024-05-04T07:50:31.747060+0000","last_active":"2024-05-04T07:50:34.907032+0000","last_peered":"2024-05-04T07:50:34.907032+0000","last_clean":"2024-05-04T07:50:34.907032+0000","last_became_active":"2024-05-04T07:50:31.746470+0000","last_became_peered":"2024-05-04T07:50:31.746470+0000","last_unstale":"2024-05-04T07:50:34.907032+0000","last_undegraded":"2024-05-04T07:50:34.907032+0000","last_fullsized":"2024-05-04T07:50:34.907032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432324+0000","last_change":"2024-05-04T07:50:27.525057+0000","last_active":"2024-05-04T07:50:34.432324+0000","last_peered":"2024-05-04T07:50:34.432324+0000","last_clean":"2024-05-04T07:50:34.432324+0000","last_became_active":"2024-05-04T07:50:27.518656+0000","last_became_peered":"2024-05-04T07:50:27.518656+0000","last_unstale":"2024-05-04T07:50:34.432324+0000","last_undegraded":"2024-05-04T07:50:34.432324+0000","last_fullsized":"2024-05-04T07:50:34.432324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706680+0000","last_change":"2024-05-04T07:50:26.509525+0000","last_active":"2024-05-04T07:50:34.706680+0000","last_peered":"2024-05-04T07:50:34.706680+0000","last_clean":"2024-05-04T07:50:34.706680+0000","last_became_active":"2024-05-04T07:50:26.509234+0000","last_became_peered":"2024-05-04T07:50:26.509234+0000","last_unstale":"2024-05-04T07:50:34.706680+0000","last_undegraded":"2024-05-04T07:50:34.706680+0000","last_fullsized":"2024-05-04T07:50:34.706680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705890+0000","last_change":"2024-05-04T07:50:31.564531+0000","last_active":"2024-05-04T07:50:34.705890+0000","last_peered":"2024-05-04T07:50:34.705890+0000","last_clean":"2024-05-04T07:50:34.705890+0000","last_became_active":"2024-05-04T07:50:31.563731+0000","last_became_peered":"2024-05-04T07:50:31.563731+0000","last_unstale":"2024-05-04T07:50:34.705890+0000","last_undegraded":"2024-05-04T07:50:34.705890+0000","last_fullsized":"2024-05-04T07:50:34.705890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575993+0000","last_change":"2024-05-04T07:50:27.534533+0000","last_active":"2024-05-04T07:50:32.575993+0000","last_peered":"2024-05-04T07:50:32.575993+0000","last_clean":"2024-05-04T07:50:32.575993+0000","last_became_active":"2024-05-04T07:50:27.530233+0000","last_became_peered":"2024-05-04T07:50:27.530233+0000","last_unstale":"2024-05-04T07:50:32.575993+0000","last_undegraded":"2024-05-04T07:50:32.575993+0000","last_fullsized":"2024-05-04T07:50:32.575993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:32.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431458+0000","last_change":"2024-05-04T07:50:26.519163+0000","last_active":"2024-05-04T07:50:34.431458+0000","last_peered":"2024-05-04T07:50:34.431458+0000","last_clean":"2024-05-04T07:50:34.431458+0000","last_became_active":"2024-05-04T07:50:26.518842+0000","last_became_peered":"2024-05-04T07:50:26.518842+0000","last_unstale":"2024-05-04T07:50:34.431458+0000","last_undegraded":"2024-05-04T07:50:34.431458+0000","last_fullsized":"2024-05-04T07:50:34.431458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:37.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706475+0000","last_change":"2024-05-04T07:50:31.568404+0000","last_active":"2024-05-04T07:50:34.706475+0000","last_peered":"2024-05-04T07:50:34.706475+0000","last_clean":"2024-05-04T07:50:34.706475+0000","last_became_active":"2024-05-04T07:50:31.568002+0000","last_became_peered":"2024-05-04T07:50:31.568002+0000","last_unstale":"2024-05-04T07:50:34.706475+0000","last_undegraded":"2024-05-04T07:50:34.706475+0000","last_fullsized":"2024-05-04T07:50:34.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706056+0000","last_change":"2024-05-04T07:50:27.514675+0000","last_active":"2024-05-04T07:50:34.706056+0000","last_peered":"2024-05-04T07:50:34.706056+0000","last_clean":"2024-05-04T07:50:34.706056+0000","last_became_active":"2024-05-04T07:50:27.514210+0000","last_became_peered":"2024-05-04T07:50:27.514210+0000","last_unstale":"2024-05-04T07:50:34.706056+0000","last_undegraded":"2024-05-04T07:50:34.706056+0000","last_fullsized":"2024-05-04T07:50:34.706056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571018+0000","last_change":"2024-05-04T07:50:26.519658+0000","last_active":"2024-05-04T07:50:32.571018+0000","last_peered":"2024-05-04T07:50:32.571018+0000","last_clean":"2024-05-04T07:50:32.571018+0000","last_became_active":"2024-05-04T07:50:26.519341+0000","last_became_peered":"2024-05-04T07:50:26.519341+0000","last_unstale":"2024-05-04T07:50:32.571018+0000","last_undegraded":"2024-05-04T07:50:32.571018+0000","last_fullsized":"2024-05-04T07:50:32.571018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707413+0000","last_change":"2024-05-04T07:50:31.573798+0000","last_active":"2024-05-04T07:50:34.707413+0000","last_peered":"2024-05-04T07:50:34.707413+0000","last_clean":"2024-05-04T07:50:34.707413+0000","last_became_active":"2024-05-04T07:50:31.573273+0000","last_became_peered":"2024-05-04T07:50:31.573273+0000","last_unstale":"2024-05-04T07:50:34.707413+0000","last_undegraded":"2024-05-04T07:50:34.707413+0000","last_fullsized":"2024-05-04T07:50:34.707413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906075+0000","last_change":"2024-05-04T07:50:27.524360+0000","last_active":"2024-05-04T07:50:34.906075+0000","last_peered":"2024-05-04T07:50:34.906075+0000","last_clean":"2024-05-04T07:50:34.906075+0000","last_became_active":"2024-05-04T07:50:27.524070+0000","last_became_peered":"2024-05-04T07:50:27.524070+0000","last_unstale":"2024-05-04T07:50:34.906075+0000","last_undegraded":"2024-05-04T07:50:34.906075+0000","last_fullsized":"2024-05-04T07:50:34.906075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:12.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675820+0000","last_change":"2024-05-04T07:50:26.516657+0000","last_active":"2024-05-04T07:50:34.675820+0000","last_peered":"2024-05-04T07:50:34.675820+0000","last_clean":"2024-05-04T07:50:34.675820+0000","last_became_active":"2024-05-04T07:50:26.516141+0000","last_became_peered":"2024-05-04T07:50:26.516141+0000","last_unstale":"2024-05-04T07:50:34.675820+0000","last_undegraded":"2024-05-04T07:50:34.675820+0000","last_fullsized":"2024-05-04T07:50:34.675820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907557+0000","last_change":"2024-05-04T07:50:31.756700+0000","last_active":"2024-05-04T07:50:34.907557+0000","last_peered":"2024-05-04T07:50:34.907557+0000","last_clean":"2024-05-04T07:50:34.907557+0000","last_became_active":"2024-05-04T07:50:31.756170+0000","last_became_peered":"2024-05-04T07:50:31.756170+0000","last_unstale":"2024-05-04T07:50:34.907557+0000","last_undegraded":"2024-05-04T07:50:34.907557+0000","last_fullsized":"2024-05-04T07:50:34.907557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884037+0000","last_change":"2024-05-04T07:50:27.539831+0000","last_active":"2024-05-04T07:50:34.884037+0000","last_peered":"2024-05-04T07:50:34.884037+0000","last_clean":"2024-05-04T07:50:34.884037+0000","last_became_active":"2024-05-04T07:50:27.539289+0000","last_became_peered":"2024-05-04T07:50:27.539289+0000","last_unstale":"2024-05-04T07:50:34.884037+0000","last_undegraded":"2024-05-04T07:50:34.884037+0000","last_fullsized":"2024-05-04T07:50:34.884037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431173+0000","last_change":"2024-05-04T07:50:26.513428+0000","last_active":"2024-05-04T07:50:34.431173+0000","last_peered":"2024-05-04T07:50:34.431173+0000","last_clean":"2024-05-04T07:50:34.431173+0000","last_became_active":"2024-05-04T07:50:26.512961+0000","last_became_peered":"2024-05-04T07:50:26.512961+0000","last_unstale":"2024-05-04T07:50:34.431173+0000","last_undegraded":"2024-05-04T07:50:34.431173+0000","last_fullsized":"2024-05-04T07:50:34.431173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676160+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:50:34.676160+0000","last_peered":"2024-05-04T07:50:34.676160+0000","last_clean":"2024-05-04T07:50:34.676160+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:50:34.676160+0000","last_undegraded":"2024-05-04T07:50:34.676160+0000","last_fullsized":"2024-05-04T07:50:34.676160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576262+0000","last_change":"2024-05-04T07:50:31.754509+0000","last_active":"2024-05-04T07:50:32.576262+0000","last_peered":"2024-05-04T07:50:32.576262+0000","last_clean":"2024-05-04T07:50:32.576262+0000","last_became_active":"2024-05-04T07:50:31.751388+0000","last_became_peered":"2024-05-04T07:50:31.751388+0000","last_unstale":"2024-05-04T07:50:32.576262+0000","last_undegraded":"2024-05-04T07:50:32.576262+0000","last_fullsized":"2024-05-04T07:50:32.576262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677129+0000","last_change":"2024-05-04T07:50:27.526484+0000","last_active":"2024-05-04T07:50:34.677129+0000","last_peered":"2024-05-04T07:50:34.677129+0000","last_clean":"2024-05-04T07:50:34.677129+0000","last_became_active":"2024-05-04T07:50:27.526184+0000","last_became_peered":"2024-05-04T07:50:27.526184+0000","last_unstale":"2024-05-04T07:50:34.677129+0000","last_undegraded":"2024-05-04T07:50:34.677129+0000","last_fullsized":"2024-05-04T07:50:34.677129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571639+0000","last_change":"2024-05-04T07:50:26.511552+0000","last_active":"2024-05-04T07:50:32.571639+0000","last_peered":"2024-05-04T07:50:32.571639+0000","last_clean":"2024-05-04T07:50:32.571639+0000","last_became_active":"2024-05-04T07:50:26.510510+0000","last_became_peered":"2024-05-04T07:50:26.510510+0000","last_unstale":"2024-05-04T07:50:32.571639+0000","last_undegraded":"2024-05-04T07:50:32.571639+0000","last_fullsized":"2024-05-04T07:50:32.571639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573035+0000","last_change":"2024-05-04T07:50:31.749615+0000","last_active":"2024-05-04T07:50:32.573035+0000","last_peered":"2024-05-04T07:50:32.573035+0000","last_clean":"2024-05-04T07:50:32.573035+0000","last_became_active":"2024-05-04T07:50:31.748418+0000","last_became_peered":"2024-05-04T07:50:31.748418+0000","last_unstale":"2024-05-04T07:50:32.573035+0000","last_undegraded":"2024-05-04T07:50:32.573035+0000","last_fullsized":"2024-05-04T07:50:32.573035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431745+0000","last_change":"2024-05-04T07:50:27.533824+0000","last_active":"2024-05-04T07:50:34.431745+0000","last_peered":"2024-05-04T07:50:34.431745+0000","last_clean":"2024-05-04T07:50:34.431745+0000","last_became_active":"2024-05-04T07:50:27.533561+0000","last_became_peered":"2024-05-04T07:50:27.533561+0000","last_unstale":"2024-05-04T07:50:34.431745+0000","last_undegraded":"2024-05-04T07:50:34.431745+0000","last_fullsized":"2024-05-04T07:50:34.431745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705144+0000","last_change":"2024-05-04T07:50:26.514911+0000","last_active":"2024-05-04T07:50:34.705144+0000","last_peered":"2024-05-04T07:50:34.705144+0000","last_clean":"2024-05-04T07:50:34.705144+0000","last_became_active":"2024-05-04T07:50:26.514615+0000","last_became_peered":"2024-05-04T07:50:26.514615+0000","last_unstale":"2024-05-04T07:50:34.705144+0000","last_undegraded":"2024-05-04T07:50:34.705144+0000","last_fullsized":"2024-05-04T07:50:34.705144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907253+0000","last_change":"2024-05-04T07:50:31.568892+0000","last_active":"2024-05-04T07:50:34.907253+0000","last_peered":"2024-05-04T07:50:34.907253+0000","last_clean":"2024-05-04T07:50:34.907253+0000","last_became_active":"2024-05-04T07:50:31.568427+0000","last_became_peered":"2024-05-04T07:50:31.568427+0000","last_unstale":"2024-05-04T07:50:34.907253+0000","last_undegraded":"2024-05-04T07:50:34.907253+0000","last_fullsized":"2024-05-04T07:50:34.907253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677795+0000","last_change":"2024-05-04T07:50:27.537511+0000","last_active":"2024-05-04T07:50:34.677795+0000","last_peered":"2024-05-04T07:50:34.677795+0000","last_clean":"2024-05-04T07:50:34.677795+0000","last_became_active":"2024-05-04T07:50:27.536076+0000","last_became_peered":"2024-05-04T07:50:27.536076+0000","last_unstale":"2024-05-04T07:50:34.677795+0000","last_undegraded":"2024-05-04T07:50:34.677795+0000","last_fullsized":"2024-05-04T07:50:34.677795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:49.223933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571866+0000","last_change":"2024-05-04T07:50:26.517157+0000","last_active":"2024-05-04T07:50:32.571866+0000","last_peered":"2024-05-04T07:50:32.571866+0000","last_clean":"2024-05-04T07:50:32.571866+0000","last_became_active":"2024-05-04T07:50:26.516874+0000","last_became_peered":"2024-05-04T07:50:26.516874+0000","last_unstale":"2024-05-04T07:50:32.571866+0000","last_undegraded":"2024-05-04T07:50:32.571866+0000","last_fullsized":"2024-05-04T07:50:32.571866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430645+0000","last_change":"2024-05-04T07:50:31.760635+0000","last_active":"2024-05-04T07:50:34.430645+0000","last_peered":"2024-05-04T07:50:34.430645+0000","last_clean":"2024-05-04T07:50:34.430645+0000","last_became_active":"2024-05-04T07:50:31.757079+0000","last_became_peered":"2024-05-04T07:50:31.757079+0000","last_unstale":"2024-05-04T07:50:34.430645+0000","last_undegraded":"2024-05-04T07:50:34.430645+0000","last_fullsized":"2024-05-04T07:50:34.430645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677343+0000","last_change":"2024-05-04T07:50:27.540454+0000","last_active":"2024-05-04T07:50:34.677343+0000","last_peered":"2024-05-04T07:50:34.677343+0000","last_clean":"2024-05-04T07:50:34.677343+0000","last_became_active":"2024-05-04T07:50:27.540144+0000","last_became_peered":"2024-05-04T07:50:27.540144+0000","last_unstale":"2024-05-04T07:50:34.677343+0000","last_undegraded":"2024-05-04T07:50:34.677343+0000","last_fullsized":"2024-05-04T07:50:34.677343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577699+0000","last_change":"2024-05-04T07:50:26.503229+0000","last_active":"2024-05-04T07:50:32.577699+0000","last_peered":"2024-05-04T07:50:32.577699+0000","last_clean":"2024-05-04T07:50:32.577699+0000","last_became_active":"2024-05-04T07:50:26.502831+0000","last_became_peered":"2024-05-04T07:50:26.502831+0000","last_unstale":"2024-05-04T07:50:32.577699+0000","last_undegraded":"2024-05-04T07:50:32.577699+0000","last_fullsized":"2024-05-04T07:50:32.577699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:08:59.681592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575067+0000","last_change":"2024-05-04T07:50:31.575538+0000","last_active":"2024-05-04T07:50:32.575067+0000","last_peered":"2024-05-04T07:50:32.575067+0000","last_clean":"2024-05-04T07:50:32.575067+0000","last_became_active":"2024-05-04T07:50:31.575246+0000","last_became_peered":"2024-05-04T07:50:31.575246+0000","last_unstale":"2024-05-04T07:50:32.575067+0000","last_undegraded":"2024-05-04T07:50:32.575067+0000","last_fullsized":"2024-05-04T07:50:32.575067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:59.402800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676420+0000","last_change":"2024-05-04T07:50:27.522684+0000","last_active":"2024-05-04T07:50:34.676420+0000","last_peered":"2024-05-04T07:50:34.676420+0000","last_clean":"2024-05-04T07:50:34.676420+0000","last_became_active":"2024-05-04T07:50:27.522411+0000","last_became_peered":"2024-05-04T07:50:27.522411+0000","last_unstale":"2024-05-04T07:50:34.676420+0000","last_undegraded":"2024-05-04T07:50:34.676420+0000","last_fullsized":"2024-05-04T07:50:34.676420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570481+0000","last_change":"2024-05-04T07:50:26.506955+0000","last_active":"2024-05-04T07:50:32.570481+0000","last_peered":"2024-05-04T07:50:32.570481+0000","last_clean":"2024-05-04T07:50:32.570481+0000","last_became_active":"2024-05-04T07:50:26.506608+0000","last_became_peered":"2024-05-04T07:50:26.506608+0000","last_unstale":"2024-05-04T07:50:32.570481+0000","last_undegraded":"2024-05-04T07:50:32.570481+0000","last_fullsized":"2024-05-04T07:50:32.570481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907170+0000","last_change":"2024-05-04T07:50:31.555725+0000","last_active":"2024-05-04T07:50:34.907170+0000","last_peered":"2024-05-04T07:50:34.907170+0000","last_clean":"2024-05-04T07:50:34.907170+0000","last_became_active":"2024-05-04T07:50:31.555270+0000","last_became_peered":"2024-05-04T07:50:31.555270+0000","last_unstale":"2024-05-04T07:50:34.907170+0000","last_undegraded":"2024-05-04T07:50:34.907170+0000","last_fullsized":"2024-05-04T07:50:34.907170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:44.773246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573323+0000","last_change":"2024-05-04T07:50:27.518477+0000","last_active":"2024-05-04T07:50:32.573323+0000","last_peered":"2024-05-04T07:50:32.573323+0000","last_clean":"2024-05-04T07:50:32.573323+0000","last_became_active":"2024-05-04T07:50:27.517791+0000","last_became_peered":"2024-05-04T07:50:27.517791+0000","last_unstale":"2024-05-04T07:50:32.573323+0000","last_undegraded":"2024-05-04T07:50:32.573323+0000","last_fullsized":"2024-05-04T07:50:32.573323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573574+0000","last_change":"2024-05-04T07:50:26.510434+0000","last_active":"2024-05-04T07:50:32.573574+0000","last_peered":"2024-05-04T07:50:32.573574+0000","last_clean":"2024-05-04T07:50:32.573574+0000","last_became_active":"2024-05-04T07:50:26.510119+0000","last_became_peered":"2024-05-04T07:50:26.510119+0000","last_unstale":"2024-05-04T07:50:32.573574+0000","last_undegraded":"2024-05-04T07:50:32.573574+0000","last_fullsized":"2024-05-04T07:50:32.573574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885212+0000","last_change":"2024-05-04T07:50:31.756666+0000","last_active":"2024-05-04T07:50:34.885212+0000","last_peered":"2024-05-04T07:50:34.885212+0000","last_clean":"2024-05-04T07:50:34.885212+0000","last_became_active":"2024-05-04T07:50:31.756249+0000","last_became_peered":"2024-05-04T07:50:31.756249+0000","last_unstale":"2024-05-04T07:50:34.885212+0000","last_undegraded":"2024-05-04T07:50:34.885212+0000","last_fullsized":"2024-05-04T07:50:34.885212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:37:24.803569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676890+0000","last_change":"2024-05-04T07:50:27.540674+0000","last_active":"2024-05-04T07:50:34.676890+0000","last_peered":"2024-05-04T07:50:34.676890+0000","last_clean":"2024-05-04T07:50:34.676890+0000","last_became_active":"2024-05-04T07:50:27.540424+0000","last_became_peered":"2024-05-04T07:50:27.540424+0000","last_unstale":"2024-05-04T07:50:34.676890+0000","last_undegraded":"2024-05-04T07:50:34.676890+0000","last_fullsized":"2024-05-04T07:50:34.676890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431291+0000","last_change":"2024-05-04T07:50:26.523666+0000","last_active":"2024-05-04T07:50:34.431291+0000","last_peered":"2024-05-04T07:50:34.431291+0000","last_clean":"2024-05-04T07:50:34.431291+0000","last_became_active":"2024-05-04T07:50:26.522969+0000","last_became_peered":"2024-05-04T07:50:26.522969+0000","last_unstale":"2024-05-04T07:50:34.431291+0000","last_undegraded":"2024-05-04T07:50:34.431291+0000","last_fullsized":"2024-05-04T07:50:34.431291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:51.372178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884708+0000","last_change":"2024-05-04T07:50:31.748030+0000","last_active":"2024-05-04T07:50:34.884708+0000","last_peered":"2024-05-04T07:50:34.884708+0000","last_clean":"2024-05-04T07:50:34.884708+0000","last_became_active":"2024-05-04T07:50:31.746933+0000","last_became_peered":"2024-05-04T07:50:31.746933+0000","last_unstale":"2024-05-04T07:50:34.884708+0000","last_undegraded":"2024-05-04T07:50:34.884708+0000","last_fullsized":"2024-05-04T07:50:34.884708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:09:59.415101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906640+0000","last_change":"2024-05-04T07:50:27.527928+0000","last_active":"2024-05-04T07:50:34.906640+0000","last_peered":"2024-05-04T07:50:34.906640+0000","last_clean":"2024-05-04T07:50:34.906640+0000","last_became_active":"2024-05-04T07:50:27.527533+0000","last_became_peered":"2024-05-04T07:50:27.527533+0000","last_unstale":"2024-05-04T07:50:34.906640+0000","last_undegraded":"2024-05-04T07:50:34.906640+0000","last_fullsized":"2024-05-04T07:50:34.906640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.905602+0000","last_change":"2024-05-04T07:50:26.513336+0000","last_active":"2024-05-04T07:50:34.905602+0000","last_peered":"2024-05-04T07:50:34.905602+0000","last_clean":"2024-05-04T07:50:34.905602+0000","last_became_active":"2024-05-04T07:50:26.512985+0000","last_became_peered":"2024-05-04T07:50:26.512985+0000","last_unstale":"2024-05-04T07:50:34.905602+0000","last_undegraded":"2024-05-04T07:50:34.905602+0000","last_fullsized":"2024-05-04T07:50:34.905602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:06.202371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432021+0000","last_change":"2024-05-04T07:50:31.749461+0000","last_active":"2024-05-04T07:50:34.432021+0000","last_peered":"2024-05-04T07:50:34.432021+0000","last_clean":"2024-05-04T07:50:34.432021+0000","last_became_active":"2024-05-04T07:50:31.748351+0000","last_became_peered":"2024-05-04T07:50:31.748351+0000","last_unstale":"2024-05-04T07:50:34.432021+0000","last_undegraded":"2024-05-04T07:50:34.432021+0000","last_fullsized":"2024-05-04T07:50:34.432021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676838+0000","last_change":"2024-05-04T07:50:27.521782+0000","last_active":"2024-05-04T07:50:34.676838+0000","last_peered":"2024-05-04T07:50:34.676838+0000","last_clean":"2024-05-04T07:50:34.676838+0000","last_became_active":"2024-05-04T07:50:27.521501+0000","last_became_peered":"2024-05-04T07:50:27.521501+0000","last_unstale":"2024-05-04T07:50:34.676838+0000","last_undegraded":"2024-05-04T07:50:34.676838+0000","last_fullsized":"2024-05-04T07:50:34.676838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:39.662272+0000","last_change":"2024-05-04T07:50:26.523082+0000","last_active":"2024-05-04T07:50:39.662272+0000","last_peered":"2024-05-04T07:50:39.662272+0000","last_clean":"2024-05-04T07:50:39.662272+0000","last_became_active":"2024-05-04T07:50:26.522745+0000","last_became_peered":"2024-05-04T07:50:26.522745+0000","last_unstale":"2024-05-04T07:50:39.662272+0000","last_undegraded":"2024-05-04T07:50:39.662272+0000","last_fullsized":"2024-05-04T07:50:39.662272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706176+0000","last_change":"2024-05-04T07:50:31.564157+0000","last_active":"2024-05-04T07:50:34.706176+0000","last_peered":"2024-05-04T07:50:34.706176+0000","last_clean":"2024-05-04T07:50:34.706176+0000","last_became_active":"2024-05-04T07:50:31.563164+0000","last_became_peered":"2024-05-04T07:50:31.563164+0000","last_unstale":"2024-05-04T07:50:34.706176+0000","last_undegraded":"2024-05-04T07:50:34.706176+0000","last_fullsized":"2024-05-04T07:50:34.706176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575072+0000","last_change":"2024-05-04T07:50:27.525542+0000","last_active":"2024-05-04T07:50:32.575072+0000","last_peered":"2024-05-04T07:50:32.575072+0000","last_clean":"2024-05-04T07:50:32.575072+0000","last_became_active":"2024-05-04T07:50:27.525248+0000","last_became_peered":"2024-05-04T07:50:27.525248+0000","last_unstale":"2024-05-04T07:50:32.575072+0000","last_undegraded":"2024-05-04T07:50:32.575072+0000","last_fullsized":"2024-05-04T07:50:32.575072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:28.619214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705230+0000","last_change":"2024-05-04T07:50:26.518937+0000","last_active":"2024-05-04T07:50:34.705230+0000","last_peered":"2024-05-04T07:50:34.705230+0000","last_clean":"2024-05-04T07:50:34.705230+0000","last_became_active":"2024-05-04T07:50:26.518493+0000","last_became_peered":"2024-05-04T07:50:26.518493+0000","last_unstale":"2024-05-04T07:50:34.705230+0000","last_undegraded":"2024-05-04T07:50:34.705230+0000","last_fullsized":"2024-05-04T07:50:34.705230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575567+0000","last_change":"2024-05-04T07:50:31.568993+0000","last_active":"2024-05-04T07:50:32.575567+0000","last_peered":"2024-05-04T07:50:32.575567+0000","last_clean":"2024-05-04T07:50:32.575567+0000","last_became_active":"2024-05-04T07:50:31.568477+0000","last_became_peered":"2024-05-04T07:50:31.568477+0000","last_unstale":"2024-05-04T07:50:32.575567+0000","last_undegraded":"2024-05-04T07:50:32.575567+0000","last_fullsized":"2024-05-04T07:50:32.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:23.224976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908175+0000","last_change":"2024-05-04T07:50:27.532480+0000","last_active":"2024-05-04T07:50:34.908175+0000","last_peered":"2024-05-04T07:50:34.908175+0000","last_clean":"2024-05-04T07:50:34.908175+0000","last_became_active":"2024-05-04T07:50:27.532194+0000","last_became_peered":"2024-05-04T07:50:27.532194+0000","last_unstale":"2024-05-04T07:50:34.908175+0000","last_undegraded":"2024-05-04T07:50:34.908175+0000","last_fullsized":"2024-05-04T07:50:34.908175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432284+0000","last_change":"2024-05-04T07:50:26.517065+0000","last_active":"2024-05-04T07:50:34.432284+0000","last_peered":"2024-05-04T07:50:34.432284+0000","last_clean":"2024-05-04T07:50:34.432284+0000","last_became_active":"2024-05-04T07:50:26.516714+0000","last_became_peered":"2024-05-04T07:50:26.516714+0000","last_unstale":"2024-05-04T07:50:34.432284+0000","last_undegraded":"2024-05-04T07:50:34.432284+0000","last_fullsized":"2024-05-04T07:50:34.432284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883217+0000","last_change":"2024-05-04T07:50:31.561005+0000","last_active":"2024-05-04T07:50:34.883217+0000","last_peered":"2024-05-04T07:50:34.883217+0000","last_clean":"2024-05-04T07:50:34.883217+0000","last_became_active":"2024-05-04T07:50:31.560530+0000","last_became_peered":"2024-05-04T07:50:31.560530+0000","last_unstale":"2024-05-04T07:50:34.883217+0000","last_undegraded":"2024-05-04T07:50:34.883217+0000","last_fullsized":"2024-05-04T07:50:34.883217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431967+0000","last_change":"2024-05-04T07:50:27.527644+0000","last_active":"2024-05-04T07:50:34.431967+0000","last_peered":"2024-05-04T07:50:34.431967+0000","last_clean":"2024-05-04T07:50:34.431967+0000","last_became_active":"2024-05-04T07:50:27.527144+0000","last_became_peered":"2024-05-04T07:50:27.527144+0000","last_unstale":"2024-05-04T07:50:34.431967+0000","last_undegraded":"2024-05-04T07:50:34.431967+0000","last_fullsized":"2024-05-04T07:50:34.431967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577526+0000","last_change":"2024-05-04T07:50:26.513482+0000","last_active":"2024-05-04T07:50:32.577526+0000","last_peered":"2024-05-04T07:50:32.577526+0000","last_clean":"2024-05-04T07:50:32.577526+0000","last_became_active":"2024-05-04T07:50:26.513184+0000","last_became_peered":"2024-05-04T07:50:26.513184+0000","last_unstale":"2024-05-04T07:50:32.577526+0000","last_undegraded":"2024-05-04T07:50:32.577526+0000","last_fullsized":"2024-05-04T07:50:32.577526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883725+0000","last_change":"2024-05-04T07:50:31.758024+0000","last_active":"2024-05-04T07:50:34.883725+0000","last_peered":"2024-05-04T07:50:34.883725+0000","last_clean":"2024-05-04T07:50:34.883725+0000","last_became_active":"2024-05-04T07:50:31.756399+0000","last_became_peered":"2024-05-04T07:50:31.756399+0000","last_unstale":"2024-05-04T07:50:34.883725+0000","last_undegraded":"2024-05-04T07:50:34.883725+0000","last_fullsized":"2024-05-04T07:50:34.883725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907003+0000","last_change":"2024-05-04T07:50:31.757980+0000","last_active":"2024-05-04T07:50:34.907003+0000","last_peered":"2024-05-04T07:50:34.907003+0000","last_clean":"2024-05-04T07:50:34.907003+0000","last_became_active":"2024-05-04T07:50:31.756577+0000","last_became_peered":"2024-05-04T07:50:31.756577+0000","last_unstale":"2024-05-04T07:50:34.907003+0000","last_undegraded":"2024-05-04T07:50:34.907003+0000","last_fullsized":"2024-05-04T07:50:34.907003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:37.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705484+0000","last_change":"2024-05-04T07:50:27.513707+0000","last_active":"2024-05-04T07:50:34.705484+0000","last_peered":"2024-05-04T07:50:34.705484+0000","last_clean":"2024-05-04T07:50:34.705484+0000","last_became_active":"2024-05-04T07:50:27.513407+0000","last_became_peered":"2024-05-04T07:50:27.513407+0000","last_unstale":"2024-05-04T07:50:34.705484+0000","last_undegraded":"2024-05-04T07:50:34.705484+0000","last_fullsized":"2024-05-04T07:50:34.705484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431437+0000","last_change":"2024-05-04T07:50:26.521863+0000","last_active":"2024-05-04T07:50:34.431437+0000","last_peered":"2024-05-04T07:50:34.431437+0000","last_clean":"2024-05-04T07:50:34.431437+0000","last_became_active":"2024-05-04T07:50:26.521362+0000","last_became_peered":"2024-05-04T07:50:26.521362+0000","last_unstale":"2024-05-04T07:50:34.431437+0000","last_undegraded":"2024-05-04T07:50:34.431437+0000","last_fullsized":"2024-05-04T07:50:34.431437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577533+0000","last_change":"2024-05-04T07:50:31.567080+0000","last_active":"2024-05-04T07:50:32.577533+0000","last_peered":"2024-05-04T07:50:32.577533+0000","last_clean":"2024-05-04T07:50:32.577533+0000","last_became_active":"2024-05-04T07:50:31.566643+0000","last_became_peered":"2024-05-04T07:50:31.566643+0000","last_unstale":"2024-05-04T07:50:32.577533+0000","last_undegraded":"2024-05-04T07:50:32.577533+0000","last_fullsized":"2024-05-04T07:50:32.577533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883291+0000","last_change":"2024-05-04T07:50:27.517785+0000","last_active":"2024-05-04T07:50:34.883291+0000","last_peered":"2024-05-04T07:50:34.883291+0000","last_clean":"2024-05-04T07:50:34.883291+0000","last_became_active":"2024-05-04T07:50:27.517532+0000","last_became_peered":"2024-05-04T07:50:27.517532+0000","last_unstale":"2024-05-04T07:50:34.883291+0000","last_undegraded":"2024-05-04T07:50:34.883291+0000","last_fullsized":"2024-05-04T07:50:34.883291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882248+0000","last_change":"2024-05-04T07:50:26.516109+0000","last_active":"2024-05-04T07:50:34.882248+0000","last_peered":"2024-05-04T07:50:34.882248+0000","last_clean":"2024-05-04T07:50:34.882248+0000","last_became_active":"2024-05-04T07:50:26.515518+0000","last_became_peered":"2024-05-04T07:50:26.515518+0000","last_unstale":"2024-05-04T07:50:34.882248+0000","last_undegraded":"2024-05-04T07:50:34.882248+0000","last_fullsized":"2024-05-04T07:50:34.882248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575304+0000","last_change":"2024-05-04T07:50:26.509275+0000","last_active":"2024-05-04T07:50:32.575304+0000","last_peered":"2024-05-04T07:50:32.575304+0000","last_clean":"2024-05-04T07:50:32.575304+0000","last_became_active":"2024-05-04T07:50:26.505492+0000","last_became_peered":"2024-05-04T07:50:26.505492+0000","last_unstale":"2024-05-04T07:50:32.575304+0000","last_undegraded":"2024-05-04T07:50:32.575304+0000","last_fullsized":"2024-05-04T07:50:32.575304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907512+0000","last_change":"2024-05-04T07:50:27.514230+0000","last_active":"2024-05-04T07:50:34.907512+0000","last_peered":"2024-05-04T07:50:34.907512+0000","last_clean":"2024-05-04T07:50:34.907512+0000","last_became_active":"2024-05-04T07:50:27.512993+0000","last_became_peered":"2024-05-04T07:50:27.512993+0000","last_unstale":"2024-05-04T07:50:34.907512+0000","last_undegraded":"2024-05-04T07:50:34.907512+0000","last_fullsized":"2024-05-04T07:50:34.907512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571374+0000","last_change":"2024-05-04T07:50:31.565560+0000","last_active":"2024-05-04T07:50:32.571374+0000","last_peered":"2024-05-04T07:50:32.571374+0000","last_clean":"2024-05-04T07:50:32.571374+0000","last_became_active":"2024-05-04T07:50:31.564371+0000","last_became_peered":"2024-05-04T07:50:31.564371+0000","last_unstale":"2024-05-04T07:50:32.571374+0000","last_undegraded":"2024-05-04T07:50:32.571374+0000","last_fullsized":"2024-05-04T07:50:32.571374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:16.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884400+0000","last_change":"2024-05-04T07:50:26.516509+0000","last_active":"2024-05-04T07:50:34.884400+0000","last_peered":"2024-05-04T07:50:34.884400+0000","last_clean":"2024-05-04T07:50:34.884400+0000","last_became_active":"2024-05-04T07:50:26.516120+0000","last_became_peered":"2024-05-04T07:50:26.516120+0000","last_unstale":"2024-05-04T07:50:34.884400+0000","last_undegraded":"2024-05-04T07:50:34.884400+0000","last_fullsized":"2024-05-04T07:50:34.884400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574616+0000","last_change":"2024-05-04T07:50:27.515095+0000","last_active":"2024-05-04T07:50:32.574616+0000","last_peered":"2024-05-04T07:50:32.574616+0000","last_clean":"2024-05-04T07:50:32.574616+0000","last_became_active":"2024-05-04T07:50:27.514715+0000","last_became_peered":"2024-05-04T07:50:27.514715+0000","last_unstale":"2024-05-04T07:50:32.574616+0000","last_undegraded":"2024-05-04T07:50:32.574616+0000","last_fullsized":"2024-05-04T07:50:32.574616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:19:00.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884950+0000","last_change":"2024-05-04T07:50:31.561861+0000","last_active":"2024-05-04T07:50:34.884950+0000","last_peered":"2024-05-04T07:50:34.884950+0000","last_clean":"2024-05-04T07:50:34.884950+0000","last_became_active":"2024-05-04T07:50:31.561513+0000","last_became_peered":"2024-05-04T07:50:31.561513+0000","last_unstale":"2024-05-04T07:50:34.884950+0000","last_undegraded":"2024-05-04T07:50:34.884950+0000","last_fullsized":"2024-05-04T07:50:34.884950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:47:50.794538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.572760+0000","last_change":"2024-05-04T07:50:27.518744+0000","last_active":"2024-05-04T07:50:32.572760+0000","last_peered":"2024-05-04T07:50:32.572760+0000","last_clean":"2024-05-04T07:50:32.572760+0000","last_became_active":"2024-05-04T07:50:27.518199+0000","last_became_peered":"2024-05-04T07:50:27.518199+0000","last_unstale":"2024-05-04T07:50:32.572760+0000","last_undegraded":"2024-05-04T07:50:32.572760+0000","last_fullsized":"2024-05-04T07:50:32.572760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570708+0000","last_change":"2024-05-04T07:50:27.523376+0000","last_active":"2024-05-04T07:50:32.570708+0000","last_peered":"2024-05-04T07:50:32.570708+0000","last_clean":"2024-05-04T07:50:32.570708+0000","last_became_active":"2024-05-04T07:50:27.523130+0000","last_became_peered":"2024-05-04T07:50:27.523130+0000","last_unstale":"2024-05-04T07:50:32.570708+0000","last_undegraded":"2024-05-04T07:50:32.570708+0000","last_fullsized":"2024-05-04T07:50:32.570708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431205+0000","last_change":"2024-05-04T07:50:27.530509+0000","last_active":"2024-05-04T07:50:34.431205+0000","last_peered":"2024-05-04T07:50:34.431205+0000","last_clean":"2024-05-04T07:50:34.431205+0000","last_became_active":"2024-05-04T07:50:27.515836+0000","last_became_peered":"2024-05-04T07:50:27.515836+0000","last_unstale":"2024-05-04T07:50:34.431205+0000","last_undegraded":"2024-05-04T07:50:34.431205+0000","last_fullsized":"2024-05-04T07:50:34.431205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907284+0000","last_change":"2024-05-04T07:50:27.514059+0000","last_active":"2024-05-04T07:50:34.907284+0000","last_peered":"2024-05-04T07:50:34.907284+0000","last_clean":"2024-05-04T07:50:34.907284+0000","last_became_active":"2024-05-04T07:50:27.513683+0000","last_became_peered":"2024-05-04T07:50:27.513683+0000","last_unstale":"2024-05-04T07:50:34.907284+0000","last_undegraded":"2024-05-04T07:50:34.907284+0000","last_fullsized":"2024-05-04T07:50:34.907284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884958+0000","last_change":"2024-05-04T07:50:27.512681+0000","last_active":"2024-05-04T07:50:34.884958+0000","last_peered":"2024-05-04T07:50:34.884958+0000","last_clean":"2024-05-04T07:50:34.884958+0000","last_became_active":"2024-05-04T07:50:27.512396+0000","last_became_peered":"2024-05-04T07:50:27.512396+0000","last_unstale":"2024-05-04T07:50:34.884958+0000","last_undegraded":"2024-05-04T07:50:34.884958+0000","last_fullsized":"2024-05-04T07:50:34.884958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706559+0000","last_change":"2024-05-04T07:50:27.513740+0000","last_active":"2024-05-04T07:50:34.706559+0000","last_peered":"2024-05-04T07:50:34.706559+0000","last_clean":"2024-05-04T07:50:34.706559+0000","last_became_active":"2024-05-04T07:50:27.513429+0000","last_became_peered":"2024-05-04T07:50:27.513429+0000","last_unstale":"2024-05-04T07:50:34.706559+0000","last_undegraded":"2024-05-04T07:50:34.706559+0000","last_fullsized":"2024-05-04T07:50:34.706559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578213+0000","last_change":"2024-05-04T07:50:27.523815+0000","last_active":"2024-05-04T07:50:32.578213+0000","last_peered":"2024-05-04T07:50:32.578213+0000","last_clean":"2024-05-04T07:50:32.578213+0000","last_became_active":"2024-05-04T07:50:27.520965+0000","last_became_peered":"2024-05-04T07:50:27.520965+0000","last_unstale":"2024-05-04T07:50:32.578213+0000","last_undegraded":"2024-05-04T07:50:32.578213+0000","last_fullsized":"2024-05-04T07:50:32.578213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885181+0000","last_change":"2024-05-04T07:50:27.512542+0000","last_active":"2024-05-04T07:50:34.885181+0000","last_peered":"2024-05-04T07:50:34.885181+0000","last_clean":"2024-05-04T07:50:34.885181+0000","last_became_active":"2024-05-04T07:50:27.511791+0000","last_became_peered":"2024-05-04T07:50:27.511791+0000","last_unstale":"2024-05-04T07:50:34.885181+0000","last_undegraded":"2024-05-04T07:50:34.885181+0000","last_fullsized":"2024-05-04T07:50:34.885181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431166+0000","last_change":"2024-05-04T07:50:27.525062+0000","last_active":"2024-05-04T07:50:34.431166+0000","last_peered":"2024-05-04T07:50:34.431166+0000","last_clean":"2024-05-04T07:50:34.431166+0000","last_became_active":"2024-05-04T07:50:27.523669+0000","last_became_peered":"2024-05-04T07:50:27.523669+0000","last_unstale":"2024-05-04T07:50:34.431166+0000","last_undegraded":"2024-05-04T07:50:34.431166+0000","last_fullsized":"2024-05-04T07:50:34.431166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883783+0000","last_change":"2024-05-04T07:50:27.529011+0000","last_active":"2024-05-04T07:50:34.883783+0000","last_peered":"2024-05-04T07:50:34.883783+0000","last_clean":"2024-05-04T07:50:34.883783+0000","last_became_active":"2024-05-04T07:50:27.518430+0000","last_became_peered":"2024-05-04T07:50:27.518430+0000","last_unstale":"2024-05-04T07:50:34.883783+0000","last_undegraded":"2024-05-04T07:50:34.883783+0000","last_fullsized":"2024-05-04T07:50:34.883783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431100+0000","last_change":"2024-05-04T07:50:27.535855+0000","last_active":"2024-05-04T07:50:34.431100+0000","last_peered":"2024-05-04T07:50:34.431100+0000","last_clean":"2024-05-04T07:50:34.431100+0000","last_became_active":"2024-05-04T07:50:27.535085+0000","last_became_peered":"2024-05-04T07:50:27.535085+0000","last_unstale":"2024-05-04T07:50:34.431100+0000","last_undegraded":"2024-05-04T07:50:34.431100+0000","last_fullsized":"2024-05-04T07:50:34.431100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906800+0000","last_change":"2024-05-04T07:50:27.517267+0000","last_active":"2024-05-04T07:50:34.906800+0000","last_peered":"2024-05-04T07:50:34.906800+0000","last_clean":"2024-05-04T07:50:34.906800+0000","last_became_active":"2024-05-04T07:50:27.516417+0000","last_became_peered":"2024-05-04T07:50:27.516417+0000","last_unstale":"2024-05-04T07:50:34.906800+0000","last_undegraded":"2024-05-04T07:50:34.906800+0000","last_fullsized":"2024-05-04T07:50:34.906800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576402+0000","last_change":"2024-05-04T07:50:27.532237+0000","last_active":"2024-05-04T07:50:32.576402+0000","last_peered":"2024-05-04T07:50:32.576402+0000","last_clean":"2024-05-04T07:50:32.576402+0000","last_became_active":"2024-05-04T07:50:27.530803+0000","last_became_peered":"2024-05-04T07:50:27.530803+0000","last_unstale":"2024-05-04T07:50:32.576402+0000","last_undegraded":"2024-05-04T07:50:32.576402+0000","last_fullsized":"2024-05-04T07:50:32.576402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677498+0000","last_change":"2024-05-04T07:50:27.521954+0000","last_active":"2024-05-04T07:50:34.677498+0000","last_peered":"2024-05-04T07:50:34.677498+0000","last_clean":"2024-05-04T07:50:34.677498+0000","last_became_active":"2024-05-04T07:50:27.521647+0000","last_became_peered":"2024-05-04T07:50:27.521647+0000","last_unstale":"2024-05-04T07:50:34.677498+0000","last_undegraded":"2024-05-04T07:50:34.677498+0000","last_fullsized":"2024-05-04T07:50:34.677498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571683+0000","last_change":"2024-05-04T07:50:27.514465+0000","last_active":"2024-05-04T07:50:32.571683+0000","last_peered":"2024-05-04T07:50:32.571683+0000","last_clean":"2024-05-04T07:50:32.571683+0000","last_became_active":"2024-05-04T07:50:27.514167+0000","last_became_peered":"2024-05-04T07:50:27.514167+0000","last_unstale":"2024-05-04T07:50:32.571683+0000","last_undegraded":"2024-05-04T07:50:32.571683+0000","last_fullsized":"2024-05-04T07:50:32.571683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:17.663860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432381+0000","last_change":"2024-05-04T07:50:27.532760+0000","last_active":"2024-05-04T07:50:34.432381+0000","last_peered":"2024-05-04T07:50:34.432381+0000","last_clean":"2024-05-04T07:50:34.432381+0000","last_became_active":"2024-05-04T07:50:27.532227+0000","last_became_peered":"2024-05-04T07:50:27.532227+0000","last_unstale":"2024-05-04T07:50:34.432381+0000","last_undegraded":"2024-05-04T07:50:34.432381+0000","last_fullsized":"2024-05-04T07:50:34.432381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430627+0000","last_change":"2024-05-04T07:50:27.526544+0000","last_active":"2024-05-04T07:50:34.430627+0000","last_peered":"2024-05-04T07:50:34.430627+0000","last_clean":"2024-05-04T07:50:34.430627+0000","last_became_active":"2024-05-04T07:50:27.523814+0000","last_became_peered":"2024-05-04T07:50:27.523814+0000","last_unstale":"2024-05-04T07:50:34.430627+0000","last_undegraded":"2024-05-04T07:50:34.430627+0000","last_fullsized":"2024-05-04T07:50:34.430627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705529+0000","last_change":"2024-05-04T07:50:27.520067+0000","last_active":"2024-05-04T07:50:34.705529+0000","last_peered":"2024-05-04T07:50:34.705529+0000","last_clean":"2024-05-04T07:50:34.705529+0000","last_became_active":"2024-05-04T07:50:27.519793+0000","last_became_peered":"2024-05-04T07:50:27.519793+0000","last_unstale":"2024-05-04T07:50:34.705529+0000","last_undegraded":"2024-05-04T07:50:34.705529+0000","last_fullsized":"2024-05-04T07:50:34.705529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906569+0000","last_change":"2024-05-04T07:50:27.519351+0000","last_active":"2024-05-04T07:50:34.906569+0000","last_peered":"2024-05-04T07:50:34.906569+0000","last_clean":"2024-05-04T07:50:34.906569+0000","last_became_active":"2024-05-04T07:50:27.519113+0000","last_became_peered":"2024-05-04T07:50:27.519113+0000","last_unstale":"2024-05-04T07:50:34.906569+0000","last_undegraded":"2024-05-04T07:50:34.906569+0000","last_fullsized":"2024-05-04T07:50:34.906569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:08.397148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884191+0000","last_change":"2024-05-04T07:50:27.512150+0000","last_active":"2024-05-04T07:50:34.884191+0000","last_peered":"2024-05-04T07:50:34.884191+0000","last_clean":"2024-05-04T07:50:34.884191+0000","last_became_active":"2024-05-04T07:50:27.511803+0000","last_became_peered":"2024-05-04T07:50:27.511803+0000","last_unstale":"2024-05-04T07:50:34.884191+0000","last_undegraded":"2024-05-04T07:50:34.884191+0000","last_fullsized":"2024-05-04T07:50:34.884191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574754+0000","last_change":"2024-05-04T07:50:27.515638+0000","last_active":"2024-05-04T07:50:32.574754+0000","last_peered":"2024-05-04T07:50:32.574754+0000","last_clean":"2024-05-04T07:50:32.574754+0000","last_became_active":"2024-05-04T07:50:27.515369+0000","last_became_peered":"2024-05-04T07:50:27.515369+0000","last_unstale":"2024-05-04T07:50:32.574754+0000","last_undegraded":"2024-05-04T07:50:32.574754+0000","last_fullsized":"2024-05-04T07:50:32.574754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577020+0000","last_change":"2024-05-04T07:50:27.526027+0000","last_active":"2024-05-04T07:50:32.577020+0000","last_peered":"2024-05-04T07:50:32.577020+0000","last_clean":"2024-05-04T07:50:32.577020+0000","last_became_active":"2024-05-04T07:50:27.525765+0000","last_became_peered":"2024-05-04T07:50:27.525765+0000","last_unstale":"2024-05-04T07:50:32.577020+0000","last_undegraded":"2024-05-04T07:50:32.577020+0000","last_fullsized":"2024-05-04T07:50:32.577020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578172+0000","last_change":"2024-05-04T07:50:27.528920+0000","last_active":"2024-05-04T07:50:32.578172+0000","last_peered":"2024-05-04T07:50:32.578172+0000","last_clean":"2024-05-04T07:50:32.578172+0000","last_became_active":"2024-05-04T07:50:27.528633+0000","last_became_peered":"2024-05-04T07:50:27.528633+0000","last_unstale":"2024-05-04T07:50:32.578172+0000","last_undegraded":"2024-05-04T07:50:32.578172+0000","last_fullsized":"2024-05-04T07:50:32.578172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677737+0000","last_change":"2024-05-04T07:50:27.539050+0000","last_active":"2024-05-04T07:50:34.677737+0000","last_peered":"2024-05-04T07:50:34.677737+0000","last_clean":"2024-05-04T07:50:34.677737+0000","last_became_active":"2024-05-04T07:50:27.538566+0000","last_became_peered":"2024-05-04T07:50:27.538566+0000","last_unstale":"2024-05-04T07:50:34.677737+0000","last_undegraded":"2024-05-04T07:50:34.677737+0000","last_fullsized":"2024-05-04T07:50:34.677737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:00.280798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882986+0000","last_change":"2024-05-04T07:50:27.530248+0000","last_active":"2024-05-04T07:50:34.882986+0000","last_peered":"2024-05-04T07:50:34.882986+0000","last_clean":"2024-05-04T07:50:34.882986+0000","last_became_active":"2024-05-04T07:50:27.529931+0000","last_became_peered":"2024-05-04T07:50:27.529931+0000","last_unstale":"2024-05-04T07:50:34.882986+0000","last_undegraded":"2024-05-04T07:50:34.882986+0000","last_fullsized":"2024-05-04T07:50:34.882986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676252+0000","last_change":"2024-05-04T07:50:27.529562+0000","last_active":"2024-05-04T07:50:34.676252+0000","last_peered":"2024-05-04T07:50:34.676252+0000","last_clean":"2024-05-04T07:50:34.676252+0000","last_became_active":"2024-05-04T07:50:27.526146+0000","last_became_peered":"2024-05-04T07:50:27.526146+0000","last_unstale":"2024-05-04T07:50:34.676252+0000","last_undegraded":"2024-05-04T07:50:34.676252+0000","last_fullsized":"2024-05-04T07:50:34.676252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430913+0000","last_change":"2024-05-04T07:50:27.535474+0000","last_active":"2024-05-04T07:50:34.430913+0000","last_peered":"2024-05-04T07:50:34.430913+0000","last_clean":"2024-05-04T07:50:34.430913+0000","last_became_active":"2024-05-04T07:50:27.534280+0000","last_became_peered":"2024-05-04T07:50:27.534280+0000","last_unstale":"2024-05-04T07:50:34.430913+0000","last_undegraded":"2024-05-04T07:50:34.430913+0000","last_fullsized":"2024-05-04T07:50:34.430913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676579+0000","last_change":"2024-05-04T07:50:27.535375+0000","last_active":"2024-05-04T07:50:34.676579+0000","last_peered":"2024-05-04T07:50:34.676579+0000","last_clean":"2024-05-04T07:50:34.676579+0000","last_became_active":"2024-05-04T07:50:27.535098+0000","last_became_peered":"2024-05-04T07:50:27.535098+0000","last_unstale":"2024-05-04T07:50:34.676579+0000","last_undegraded":"2024-05-04T07:50:34.676579+0000","last_fullsized":"2024-05-04T07:50:34.676579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431426+0000","last_change":"2024-05-04T07:50:27.524844+0000","last_active":"2024-05-04T07:50:34.431426+0000","last_peered":"2024-05-04T07:50:34.431426+0000","last_clean":"2024-05-04T07:50:34.431426+0000","last_became_active":"2024-05-04T07:50:27.516441+0000","last_became_peered":"2024-05-04T07:50:27.516441+0000","last_unstale":"2024-05-04T07:50:34.431426+0000","last_undegraded":"2024-05-04T07:50:34.431426+0000","last_fullsized":"2024-05-04T07:50:34.431426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907140+0000","last_change":"2024-05-04T07:50:27.510561+0000","last_active":"2024-05-04T07:50:34.907140+0000","last_peered":"2024-05-04T07:50:34.907140+0000","last_clean":"2024-05-04T07:50:34.907140+0000","last_became_active":"2024-05-04T07:50:27.510197+0000","last_became_peered":"2024-05-04T07:50:27.510197+0000","last_unstale":"2024-05-04T07:50:34.907140+0000","last_undegraded":"2024-05-04T07:50:34.907140+0000","last_fullsized":"2024-05-04T07:50:34.907140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707313+0000","last_change":"2024-05-04T07:50:27.520114+0000","last_active":"2024-05-04T07:50:34.707313+0000","last_peered":"2024-05-04T07:50:34.707313+0000","last_clean":"2024-05-04T07:50:34.707313+0000","last_became_active":"2024-05-04T07:50:27.518799+0000","last_became_peered":"2024-05-04T07:50:27.518799+0000","last_unstale":"2024-05-04T07:50:34.707313+0000","last_undegraded":"2024-05-04T07:50:34.707313+0000","last_fullsized":"2024-05-04T07:50:34.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677494+0000","last_change":"2024-05-04T07:50:27.521160+0000","last_active":"2024-05-04T07:50:34.677494+0000","last_peered":"2024-05-04T07:50:34.677494+0000","last_clean":"2024-05-04T07:50:34.677494+0000","last_became_active":"2024-05-04T07:50:27.520786+0000","last_became_peered":"2024-05-04T07:50:27.520786+0000","last_unstale":"2024-05-04T07:50:34.677494+0000","last_undegraded":"2024-05-04T07:50:34.677494+0000","last_fullsized":"2024-05-04T07:50:34.677494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:37.987648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:50:51.084 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:50:51.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.325+0000 7f918aa00640 1 Processor -- start 2024-05-04T07:50:51.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.325+0000 7f918aa00640 1 -- start start 2024-05-04T07:50:51.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f918aa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f918406f930 0x7f91840cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f918aa00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91840cee00 con 0x7f91840afc80 2024-05-04T07:50:51.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f918aa00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91840cf0e0 con 0x7f91840ce8d0 2024-05-04T07:50:51.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f918aa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f91840d1840 con 0x7f918406f930 2024-05-04T07:50:51.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f9189600640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f91840afc80 0x7f9184071d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41432/0 (socket says 172.21.15.136:41432) 2024-05-04T07:50:51.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f9189600640 1 -- 172.21.15.136:0/2992732152 learned_addr learned my addr 172.21.15.136:0/2992732152 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f918a000640 1 --2- 172.21.15.136:0/2992732152 >> v2:172.21.15.142:3300/0 conn(0x7f918406f930 0x7f91840cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152552419 0 0) 0x7f91840cee00 con 0x7f91840afc80 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.327+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f916c003520 con 0x7f91840afc80 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 804263532 0 0) 0x7f916c003520 con 0x7f91840afc80 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 >> v2:172.21.15.142:3300/0 conn(0x7f918406f930 msgr2=0x7f91840cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 --2- 172.21.15.136:0/2992732152 >> v2:172.21.15.142:3300/0 conn(0x7f918406f930 0x7f91840cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 >> v1:172.21.15.142:6789/0 conn(0x7f91840ce8d0 legacy=0x7f918406f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91840cf3c0 con 0x7f91840afc80 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f91780016f0 con 0x7f91840afc80 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 >> v1:172.21.15.136:6789/0 conn(0x7f91840afc80 legacy=0x7f9184071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.330 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c003a50 0x7f916c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f916c00c0c0 con 0x7f916c0051c0 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f916c00c270 con 0x7f916c003a50 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f916c00c470 con 0x7f916c004800 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f918a000640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.328+0000 7f9189600640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c003a50 0x7f916c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f9188c00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f918a000640 1 -- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f916c004800 msgr2=0x7f916c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f918a000640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f918a000640 1 -- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c003a50 msgr2=0x7f916c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f918a000640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c003a50 0x7f916c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.329+0000 7f918a000640 1 -- 172.21.15.136:0/2992732152 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c003520 con 0x7f916c0051c0 2024-05-04T07:50:51.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.330+0000 7f918a000640 1 -- 172.21.15.136:0/2992732152 reap_dead start 2024-05-04T07:50:51.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.330+0000 7f918a000640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f917c009f90 tx=0x7f916c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e3d5853222897e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.330+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c035020 con 0x7f916c0051c0 2024-05-04T07:50:51.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.330+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c003b90 con 0x7f916c0051c0 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.330+0000 7f9183e00640 1 -- 172.21.15.136:0/2992732152 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c009c10 con 0x7f916c0051c0 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 -- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 msgr2=0x7f916c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f917c009f90 tx=0x7f916c005830 comp rx=0 tx=0).stop 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 -- 172.21.15.136:0/2992732152 shutdown_connections 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 --2- 172.21.15.136:0/2992732152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 -- 172.21.15.136:0/2992732152 >> 172.21.15.136:0/2992732152 conn(0x7f91840d09d0 msgr2=0x7f91840d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 -- 172.21.15.136:0/2992732152 shutdown_connections 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.331+0000 7f918aa00640 1 -- 172.21.15.136:0/2992732152 wait complete. 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.333+0000 7f918aa00640 1 Processor -- start 2024-05-04T07:50:51.334 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.333+0000 7f918aa00640 1 -- start start 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c0051c0 0x7f91840c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b4dc0 0x7f918406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91840b0060 con 0x7f918415c0b0 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f91840cf980 con 0x7f916c0051c0 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918aa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91840b01e0 con 0x7f91840b4dc0 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38908/0 (socket says 172.21.15.136:38908) 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 -- 172.21.15.136:0/1955396778 learned_addr learned my addr 172.21.15.136:0/1955396778 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9189600640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c0051c0 0x7f91840c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f918a000640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b4dc0 0x7f918406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 -- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b4dc0 msgr2=0x7f918406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b4dc0 0x7f918406dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 -- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c0051c0 msgr2=0x7f91840c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.334+0000 7f9188c00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c0051c0 0x7f91840c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f9188c00640 1 -- 172.21.15.136:0/1955396778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91840c6100 con 0x7f918415c0b0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f9188c00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f917000e460 tx=0x7f917000e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700135f0 con 0x7f918415c0b0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917001a070 con 0x7f918415c0b0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91700139d0 con 0x7f918415c0b0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91840c63e0 con 0x7f918415c0b0 2024-05-04T07:50:51.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.335+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91840c69a0 con 0x7f918415c0b0 2024-05-04T07:50:51.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.337+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91840b51d0 con 0x7f918415c0b0 2024-05-04T07:50:51.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.338+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9170013b70 con 0x7f918415c0b0 2024-05-04T07:50:51.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.339+0000 7f9181600640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 0x7f9164078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.339+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9170097cb0 con 0x7f918415c0b0 2024-05-04T07:50:51.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.340+0000 7f9189600640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 0x7f9164078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.340+0000 7f9189600640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 0x7f9164078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f91840b23e0 tx=0x7f9178009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.344+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91840b51d0 con 0x7f918415c0b0 2024-05-04T07:50:51.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.551+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91840c6ba0 con 0x7f91640762d0 2024-05-04T07:50:51.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.576+0000 7f9181600640 1 -- 172.21.15.136:0/1955396778 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f91840c6ba0 con 0x7f91640762d0 2024-05-04T07:50:51.580 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:51.583 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 msgr2=0x7f9164078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 0x7f9164078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f91840b23e0 tx=0x7f9178009040 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 msgr2=0x7f91840b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f917000e460 tx=0x7f917000e920 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 shutdown_connections 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f91640762d0 0x7f9164078790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91840b4dc0 0x7f918406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f918415c0b0 0x7f91840b4880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 --2- 172.21.15.136:0/1955396778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f916c0051c0 0x7f91840c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 >> 172.21.15.136:0/1955396778 conn(0x7f91840d09d0 msgr2=0x7f918415fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 shutdown_connections 2024-05-04T07:50:51.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.584+0000 7f918aa00640 1 -- 172.21.15.136:0/1955396778 wait complete. 2024-05-04T07:50:51.604 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-04T07:50:51.278479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005201"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908156+0000","last_change":"2024-05-04T07:50:26.511444+0000","last_active":"2024-05-04T07:50:34.908156+0000","last_peered":"2024-05-04T07:50:34.908156+0000","last_clean":"2024-05-04T07:50:34.908156+0000","last_became_active":"2024-05-04T07:50:26.511184+0000","last_became_peered":"2024-05-04T07:50:26.511184+0000","last_unstale":"2024-05-04T07:50:34.908156+0000","last_undegraded":"2024-05-04T07:50:34.908156+0000","last_fullsized":"2024-05-04T07:50:34.908156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885131+0000","last_change":"2024-05-04T07:50:27.511810+0000","last_active":"2024-05-04T07:50:34.885131+0000","last_peered":"2024-05-04T07:50:34.885131+0000","last_clean":"2024-05-04T07:50:34.885131+0000","last_became_active":"2024-05-04T07:50:27.511405+0000","last_became_peered":"2024-05-04T07:50:27.511405+0000","last_unstale":"2024-05-04T07:50:34.885131+0000","last_undegraded":"2024-05-04T07:50:34.885131+0000","last_fullsized":"2024-05-04T07:50:34.885131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883149+0000","last_change":"2024-05-04T07:50:31.757139+0000","last_active":"2024-05-04T07:50:34.883149+0000","last_peered":"2024-05-04T07:50:34.883149+0000","last_clean":"2024-05-04T07:50:34.883149+0000","last_became_active":"2024-05-04T07:50:31.756650+0000","last_became_peered":"2024-05-04T07:50:31.756650+0000","last_unstale":"2024-05-04T07:50:34.883149+0000","last_undegraded":"2024-05-04T07:50:34.883149+0000","last_fullsized":"2024-05-04T07:50:34.883149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885411+0000","last_change":"2024-05-04T07:50:26.515716+0000","last_active":"2024-05-04T07:50:34.885411+0000","last_peered":"2024-05-04T07:50:34.885411+0000","last_clean":"2024-05-04T07:50:34.885411+0000","last_became_active":"2024-05-04T07:50:26.515369+0000","last_became_peered":"2024-05-04T07:50:26.515369+0000","last_unstale":"2024-05-04T07:50:34.885411+0000","last_undegraded":"2024-05-04T07:50:34.885411+0000","last_fullsized":"2024-05-04T07:50:34.885411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907863+0000","last_change":"2024-05-04T07:50:27.532568+0000","last_active":"2024-05-04T07:50:34.907863+0000","last_peered":"2024-05-04T07:50:34.907863+0000","last_clean":"2024-05-04T07:50:34.907863+0000","last_became_active":"2024-05-04T07:50:27.532259+0000","last_became_peered":"2024-05-04T07:50:27.532259+0000","last_unstale":"2024-05-04T07:50:34.907863+0000","last_undegraded":"2024-05-04T07:50:34.907863+0000","last_fullsized":"2024-05-04T07:50:34.907863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574294+0000","last_change":"2024-05-04T07:50:31.571444+0000","last_active":"2024-05-04T07:50:32.574294+0000","last_peered":"2024-05-04T07:50:32.574294+0000","last_clean":"2024-05-04T07:50:32.574294+0000","last_became_active":"2024-05-04T07:50:31.570161+0000","last_became_peered":"2024-05-04T07:50:31.570161+0000","last_unstale":"2024-05-04T07:50:32.574294+0000","last_undegraded":"2024-05-04T07:50:32.574294+0000","last_fullsized":"2024-05-04T07:50:32.574294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:20.105139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.520446+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.519707+0000","last_became_peered":"2024-05-04T07:50:26.519707+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:04:46.769896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431704+0000","last_change":"2024-05-04T07:50:27.531288+0000","last_active":"2024-05-04T07:50:34.431704+0000","last_peered":"2024-05-04T07:50:34.431704+0000","last_clean":"2024-05-04T07:50:34.431704+0000","last_became_active":"2024-05-04T07:50:27.531005+0000","last_became_peered":"2024-05-04T07:50:27.531005+0000","last_unstale":"2024-05-04T07:50:34.431704+0000","last_undegraded":"2024-05-04T07:50:34.431704+0000","last_fullsized":"2024-05-04T07:50:34.431704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575189+0000","last_change":"2024-05-04T07:50:31.568998+0000","last_active":"2024-05-04T07:50:32.575189+0000","last_peered":"2024-05-04T07:50:32.575189+0000","last_clean":"2024-05-04T07:50:32.575189+0000","last_became_active":"2024-05-04T07:50:31.568443+0000","last_became_peered":"2024-05-04T07:50:31.568443+0000","last_unstale":"2024-05-04T07:50:32.575189+0000","last_undegraded":"2024-05-04T07:50:32.575189+0000","last_fullsized":"2024-05-04T07:50:32.575189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:11.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675279+0000","last_change":"2024-05-04T07:50:26.523596+0000","last_active":"2024-05-04T07:50:34.675279+0000","last_peered":"2024-05-04T07:50:34.675279+0000","last_clean":"2024-05-04T07:50:34.675279+0000","last_became_active":"2024-05-04T07:50:26.523247+0000","last_became_peered":"2024-05-04T07:50:26.523247+0000","last_unstale":"2024-05-04T07:50:34.675279+0000","last_undegraded":"2024-05-04T07:50:34.675279+0000","last_fullsized":"2024-05-04T07:50:34.675279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431910+0000","last_change":"2024-05-04T07:50:27.527272+0000","last_active":"2024-05-04T07:50:34.431910+0000","last_peered":"2024-05-04T07:50:34.431910+0000","last_clean":"2024-05-04T07:50:34.431910+0000","last_became_active":"2024-05-04T07:50:27.526746+0000","last_became_peered":"2024-05-04T07:50:27.526746+0000","last_unstale":"2024-05-04T07:50:34.431910+0000","last_undegraded":"2024-05-04T07:50:34.431910+0000","last_fullsized":"2024-05-04T07:50:34.431910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574307+0000","last_change":"2024-05-04T07:50:31.557824+0000","last_active":"2024-05-04T07:50:32.574307+0000","last_peered":"2024-05-04T07:50:32.574307+0000","last_clean":"2024-05-04T07:50:32.574307+0000","last_became_active":"2024-05-04T07:50:31.557272+0000","last_became_peered":"2024-05-04T07:50:31.557272+0000","last_unstale":"2024-05-04T07:50:32.574307+0000","last_undegraded":"2024-05-04T07:50:32.574307+0000","last_fullsized":"2024-05-04T07:50:32.574307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:15.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574756+0000","last_change":"2024-05-04T07:50:27.530293+0000","last_active":"2024-05-04T07:50:32.574756+0000","last_peered":"2024-05-04T07:50:32.574756+0000","last_clean":"2024-05-04T07:50:32.574756+0000","last_became_active":"2024-05-04T07:50:27.529984+0000","last_became_peered":"2024-05-04T07:50:27.529984+0000","last_unstale":"2024-05-04T07:50:32.574756+0000","last_undegraded":"2024-05-04T07:50:32.574756+0000","last_fullsized":"2024-05-04T07:50:32.574756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.521571+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.521188+0000","last_became_peered":"2024-05-04T07:50:26.521188+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:11.871066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576679+0000","last_change":"2024-05-04T07:50:31.570676+0000","last_active":"2024-05-04T07:50:32.576679+0000","last_peered":"2024-05-04T07:50:32.576679+0000","last_clean":"2024-05-04T07:50:32.576679+0000","last_became_active":"2024-05-04T07:50:31.570276+0000","last_became_peered":"2024-05-04T07:50:31.570276+0000","last_unstale":"2024-05-04T07:50:32.576679+0000","last_undegraded":"2024-05-04T07:50:32.576679+0000","last_fullsized":"2024-05-04T07:50:32.576679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884190+0000","last_change":"2024-05-04T07:50:27.532074+0000","last_active":"2024-05-04T07:50:34.884190+0000","last_peered":"2024-05-04T07:50:34.884190+0000","last_clean":"2024-05-04T07:50:34.884190+0000","last_became_active":"2024-05-04T07:50:27.529720+0000","last_became_peered":"2024-05-04T07:50:27.529720+0000","last_unstale":"2024-05-04T07:50:34.884190+0000","last_undegraded":"2024-05-04T07:50:34.884190+0000","last_fullsized":"2024-05-04T07:50:34.884190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706867+0000","last_change":"2024-05-04T07:50:26.523351+0000","last_active":"2024-05-04T07:50:34.706867+0000","last_peered":"2024-05-04T07:50:34.706867+0000","last_clean":"2024-05-04T07:50:34.706867+0000","last_became_active":"2024-05-04T07:50:26.522661+0000","last_became_peered":"2024-05-04T07:50:26.522661+0000","last_unstale":"2024-05-04T07:50:34.706867+0000","last_undegraded":"2024-05-04T07:50:34.706867+0000","last_fullsized":"2024-05-04T07:50:34.706867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574356+0000","last_change":"2024-05-04T07:50:31.569229+0000","last_active":"2024-05-04T07:50:32.574356+0000","last_peered":"2024-05-04T07:50:32.574356+0000","last_clean":"2024-05-04T07:50:32.574356+0000","last_became_active":"2024-05-04T07:50:31.568499+0000","last_became_peered":"2024-05-04T07:50:31.568499+0000","last_unstale":"2024-05-04T07:50:32.574356+0000","last_undegraded":"2024-05-04T07:50:32.574356+0000","last_fullsized":"2024-05-04T07:50:32.574356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:01.830913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883443+0000","last_change":"2024-05-04T07:50:27.528537+0000","last_active":"2024-05-04T07:50:34.883443+0000","last_peered":"2024-05-04T07:50:34.883443+0000","last_clean":"2024-05-04T07:50:34.883443+0000","last_became_active":"2024-05-04T07:50:27.528071+0000","last_became_peered":"2024-05-04T07:50:27.528071+0000","last_unstale":"2024-05-04T07:50:34.883443+0000","last_undegraded":"2024-05-04T07:50:34.883443+0000","last_fullsized":"2024-05-04T07:50:34.883443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705613+0000","last_change":"2024-05-04T07:50:26.509143+0000","last_active":"2024-05-04T07:50:34.705613+0000","last_peered":"2024-05-04T07:50:34.705613+0000","last_clean":"2024-05-04T07:50:34.705613+0000","last_became_active":"2024-05-04T07:50:26.508476+0000","last_became_peered":"2024-05-04T07:50:26.508476+0000","last_unstale":"2024-05-04T07:50:34.705613+0000","last_undegraded":"2024-05-04T07:50:34.705613+0000","last_fullsized":"2024-05-04T07:50:34.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707315+0000","last_change":"2024-05-04T07:50:31.751464+0000","last_active":"2024-05-04T07:50:34.707315+0000","last_peered":"2024-05-04T07:50:34.707315+0000","last_clean":"2024-05-04T07:50:34.707315+0000","last_became_active":"2024-05-04T07:50:31.751012+0000","last_became_peered":"2024-05-04T07:50:31.751012+0000","last_unstale":"2024-05-04T07:50:34.707315+0000","last_undegraded":"2024-05-04T07:50:34.707315+0000","last_fullsized":"2024-05-04T07:50:34.707315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576462+0000","last_change":"2024-05-04T07:50:27.503181+0000","last_active":"2024-05-04T07:50:32.576462+0000","last_peered":"2024-05-04T07:50:32.576462+0000","last_clean":"2024-05-04T07:50:32.576462+0000","last_became_active":"2024-05-04T07:50:27.502878+0000","last_became_peered":"2024-05-04T07:50:27.502878+0000","last_unstale":"2024-05-04T07:50:32.576462+0000","last_undegraded":"2024-05-04T07:50:32.576462+0000","last_fullsized":"2024-05-04T07:50:32.576462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:33.061709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675823+0000","last_change":"2024-05-04T07:50:26.516424+0000","last_active":"2024-05-04T07:50:34.675823+0000","last_peered":"2024-05-04T07:50:34.675823+0000","last_clean":"2024-05-04T07:50:34.675823+0000","last_became_active":"2024-05-04T07:50:26.515804+0000","last_became_peered":"2024-05-04T07:50:26.515804+0000","last_unstale":"2024-05-04T07:50:34.675823+0000","last_undegraded":"2024-05-04T07:50:34.675823+0000","last_fullsized":"2024-05-04T07:50:34.675823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576592+0000","last_change":"2024-05-04T07:50:31.571745+0000","last_active":"2024-05-04T07:50:32.576592+0000","last_peered":"2024-05-04T07:50:32.576592+0000","last_clean":"2024-05-04T07:50:32.576592+0000","last_became_active":"2024-05-04T07:50:31.571236+0000","last_became_peered":"2024-05-04T07:50:31.571236+0000","last_unstale":"2024-05-04T07:50:32.576592+0000","last_undegraded":"2024-05-04T07:50:32.576592+0000","last_fullsized":"2024-05-04T07:50:32.576592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907548+0000","last_change":"2024-05-04T07:50:27.520723+0000","last_active":"2024-05-04T07:50:34.907548+0000","last_peered":"2024-05-04T07:50:34.907548+0000","last_clean":"2024-05-04T07:50:34.907548+0000","last_became_active":"2024-05-04T07:50:27.520401+0000","last_became_peered":"2024-05-04T07:50:27.520401+0000","last_unstale":"2024-05-04T07:50:34.907548+0000","last_undegraded":"2024-05-04T07:50:34.907548+0000","last_fullsized":"2024-05-04T07:50:34.907548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577779+0000","last_change":"2024-05-04T07:50:26.508044+0000","last_active":"2024-05-04T07:50:32.577779+0000","last_peered":"2024-05-04T07:50:32.577779+0000","last_clean":"2024-05-04T07:50:32.577779+0000","last_became_active":"2024-05-04T07:50:26.507669+0000","last_became_peered":"2024-05-04T07:50:26.507669+0000","last_unstale":"2024-05-04T07:50:32.577779+0000","last_undegraded":"2024-05-04T07:50:32.577779+0000","last_fullsized":"2024-05-04T07:50:32.577779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576003+0000","last_change":"2024-05-04T07:50:31.751252+0000","last_active":"2024-05-04T07:50:32.576003+0000","last_peered":"2024-05-04T07:50:32.576003+0000","last_clean":"2024-05-04T07:50:32.576003+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:32.576003+0000","last_undegraded":"2024-05-04T07:50:32.576003+0000","last_fullsized":"2024-05-04T07:50:32.576003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885325+0000","last_change":"2024-05-04T07:50:27.529761+0000","last_active":"2024-05-04T07:50:34.885325+0000","last_peered":"2024-05-04T07:50:34.885325+0000","last_clean":"2024-05-04T07:50:34.885325+0000","last_became_active":"2024-05-04T07:50:27.529312+0000","last_became_peered":"2024-05-04T07:50:27.529312+0000","last_unstale":"2024-05-04T07:50:34.885325+0000","last_undegraded":"2024-05-04T07:50:34.885325+0000","last_fullsized":"2024-05-04T07:50:34.885325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705096+0000","last_change":"2024-05-04T07:50:26.510946+0000","last_active":"2024-05-04T07:50:34.705096+0000","last_peered":"2024-05-04T07:50:34.705096+0000","last_clean":"2024-05-04T07:50:34.705096+0000","last_became_active":"2024-05-04T07:50:26.510126+0000","last_became_peered":"2024-05-04T07:50:26.510126+0000","last_unstale":"2024-05-04T07:50:34.705096+0000","last_undegraded":"2024-05-04T07:50:34.705096+0000","last_fullsized":"2024-05-04T07:50:34.705096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882789+0000","last_change":"2024-05-04T07:50:31.748699+0000","last_active":"2024-05-04T07:50:34.882789+0000","last_peered":"2024-05-04T07:50:34.882789+0000","last_clean":"2024-05-04T07:50:34.882789+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:34.882789+0000","last_undegraded":"2024-05-04T07:50:34.882789+0000","last_fullsized":"2024-05-04T07:50:34.882789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706580+0000","last_change":"2024-05-04T07:50:27.517196+0000","last_active":"2024-05-04T07:50:34.706580+0000","last_peered":"2024-05-04T07:50:34.706580+0000","last_clean":"2024-05-04T07:50:34.706580+0000","last_became_active":"2024-05-04T07:50:27.516775+0000","last_became_peered":"2024-05-04T07:50:27.516775+0000","last_unstale":"2024-05-04T07:50:34.706580+0000","last_undegraded":"2024-05-04T07:50:34.706580+0000","last_fullsized":"2024-05-04T07:50:34.706580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677514+0000","last_change":"2024-05-04T07:50:26.522492+0000","last_active":"2024-05-04T07:50:34.677514+0000","last_peered":"2024-05-04T07:50:34.677514+0000","last_clean":"2024-05-04T07:50:34.677514+0000","last_became_active":"2024-05-04T07:50:26.522237+0000","last_became_peered":"2024-05-04T07:50:26.522237+0000","last_unstale":"2024-05-04T07:50:34.677514+0000","last_undegraded":"2024-05-04T07:50:34.677514+0000","last_fullsized":"2024-05-04T07:50:34.677514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:49:19.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907032+0000","last_change":"2024-05-04T07:50:31.747060+0000","last_active":"2024-05-04T07:50:34.907032+0000","last_peered":"2024-05-04T07:50:34.907032+0000","last_clean":"2024-05-04T07:50:34.907032+0000","last_became_active":"2024-05-04T07:50:31.746470+0000","last_became_peered":"2024-05-04T07:50:31.746470+0000","last_unstale":"2024-05-04T07:50:34.907032+0000","last_undegraded":"2024-05-04T07:50:34.907032+0000","last_fullsized":"2024-05-04T07:50:34.907032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432324+0000","last_change":"2024-05-04T07:50:27.525057+0000","last_active":"2024-05-04T07:50:34.432324+0000","last_peered":"2024-05-04T07:50:34.432324+0000","last_clean":"2024-05-04T07:50:34.432324+0000","last_became_active":"2024-05-04T07:50:27.518656+0000","last_became_peered":"2024-05-04T07:50:27.518656+0000","last_unstale":"2024-05-04T07:50:34.432324+0000","last_undegraded":"2024-05-04T07:50:34.432324+0000","last_fullsized":"2024-05-04T07:50:34.432324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706680+0000","last_change":"2024-05-04T07:50:26.509525+0000","last_active":"2024-05-04T07:50:34.706680+0000","last_peered":"2024-05-04T07:50:34.706680+0000","last_clean":"2024-05-04T07:50:34.706680+0000","last_became_active":"2024-05-04T07:50:26.509234+0000","last_became_peered":"2024-05-04T07:50:26.509234+0000","last_unstale":"2024-05-04T07:50:34.706680+0000","last_undegraded":"2024-05-04T07:50:34.706680+0000","last_fullsized":"2024-05-04T07:50:34.706680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705890+0000","last_change":"2024-05-04T07:50:31.564531+0000","last_active":"2024-05-04T07:50:34.705890+0000","last_peered":"2024-05-04T07:50:34.705890+0000","last_clean":"2024-05-04T07:50:34.705890+0000","last_became_active":"2024-05-04T07:50:31.563731+0000","last_became_peered":"2024-05-04T07:50:31.563731+0000","last_unstale":"2024-05-04T07:50:34.705890+0000","last_undegraded":"2024-05-04T07:50:34.705890+0000","last_fullsized":"2024-05-04T07:50:34.705890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575993+0000","last_change":"2024-05-04T07:50:27.534533+0000","last_active":"2024-05-04T07:50:32.575993+0000","last_peered":"2024-05-04T07:50:32.575993+0000","last_clean":"2024-05-04T07:50:32.575993+0000","last_became_active":"2024-05-04T07:50:27.530233+0000","last_became_peered":"2024-05-04T07:50:27.530233+0000","last_unstale":"2024-05-04T07:50:32.575993+0000","last_undegraded":"2024-05-04T07:50:32.575993+0000","last_fullsized":"2024-05-04T07:50:32.575993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:32.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431458+0000","last_change":"2024-05-04T07:50:26.519163+0000","last_active":"2024-05-04T07:50:34.431458+0000","last_peered":"2024-05-04T07:50:34.431458+0000","last_clean":"2024-05-04T07:50:34.431458+0000","last_became_active":"2024-05-04T07:50:26.518842+0000","last_became_peered":"2024-05-04T07:50:26.518842+0000","last_unstale":"2024-05-04T07:50:34.431458+0000","last_undegraded":"2024-05-04T07:50:34.431458+0000","last_fullsized":"2024-05-04T07:50:34.431458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:37.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706475+0000","last_change":"2024-05-04T07:50:31.568404+0000","last_active":"2024-05-04T07:50:34.706475+0000","last_peered":"2024-05-04T07:50:34.706475+0000","last_clean":"2024-05-04T07:50:34.706475+0000","last_became_active":"2024-05-04T07:50:31.568002+0000","last_became_peered":"2024-05-04T07:50:31.568002+0000","last_unstale":"2024-05-04T07:50:34.706475+0000","last_undegraded":"2024-05-04T07:50:34.706475+0000","last_fullsized":"2024-05-04T07:50:34.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706056+0000","last_change":"2024-05-04T07:50:27.514675+0000","last_active":"2024-05-04T07:50:34.706056+0000","last_peered":"2024-05-04T07:50:34.706056+0000","last_clean":"2024-05-04T07:50:34.706056+0000","last_became_active":"2024-05-04T07:50:27.514210+0000","last_became_peered":"2024-05-04T07:50:27.514210+0000","last_unstale":"2024-05-04T07:50:34.706056+0000","last_undegraded":"2024-05-04T07:50:34.706056+0000","last_fullsized":"2024-05-04T07:50:34.706056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571018+0000","last_change":"2024-05-04T07:50:26.519658+0000","last_active":"2024-05-04T07:50:32.571018+0000","last_peered":"2024-05-04T07:50:32.571018+0000","last_clean":"2024-05-04T07:50:32.571018+0000","last_became_active":"2024-05-04T07:50:26.519341+0000","last_became_peered":"2024-05-04T07:50:26.519341+0000","last_unstale":"2024-05-04T07:50:32.571018+0000","last_undegraded":"2024-05-04T07:50:32.571018+0000","last_fullsized":"2024-05-04T07:50:32.571018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707413+0000","last_change":"2024-05-04T07:50:31.573798+0000","last_active":"2024-05-04T07:50:34.707413+0000","last_peered":"2024-05-04T07:50:34.707413+0000","last_clean":"2024-05-04T07:50:34.707413+0000","last_became_active":"2024-05-04T07:50:31.573273+0000","last_became_peered":"2024-05-04T07:50:31.573273+0000","last_unstale":"2024-05-04T07:50:34.707413+0000","last_undegraded":"2024-05-04T07:50:34.707413+0000","last_fullsized":"2024-05-04T07:50:34.707413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906075+0000","last_change":"2024-05-04T07:50:27.524360+0000","last_active":"2024-05-04T07:50:34.906075+0000","last_peered":"2024-05-04T07:50:34.906075+0000","last_clean":"2024-05-04T07:50:34.906075+0000","last_became_active":"2024-05-04T07:50:27.524070+0000","last_became_peered":"2024-05-04T07:50:27.524070+0000","last_unstale":"2024-05-04T07:50:34.906075+0000","last_undegraded":"2024-05-04T07:50:34.906075+0000","last_fullsized":"2024-05-04T07:50:34.906075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:12.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675820+0000","last_change":"2024-05-04T07:50:26.516657+0000","last_active":"2024-05-04T07:50:34.675820+0000","last_peered":"2024-05-04T07:50:34.675820+0000","last_clean":"2024-05-04T07:50:34.675820+0000","last_became_active":"2024-05-04T07:50:26.516141+0000","last_became_peered":"2024-05-04T07:50:26.516141+0000","last_unstale":"2024-05-04T07:50:34.675820+0000","last_undegraded":"2024-05-04T07:50:34.675820+0000","last_fullsized":"2024-05-04T07:50:34.675820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907557+0000","last_change":"2024-05-04T07:50:31.756700+0000","last_active":"2024-05-04T07:50:34.907557+0000","last_peered":"2024-05-04T07:50:34.907557+0000","last_clean":"2024-05-04T07:50:34.907557+0000","last_became_active":"2024-05-04T07:50:31.756170+0000","last_became_peered":"2024-05-04T07:50:31.756170+0000","last_unstale":"2024-05-04T07:50:34.907557+0000","last_undegraded":"2024-05-04T07:50:34.907557+0000","last_fullsized":"2024-05-04T07:50:34.907557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884037+0000","last_change":"2024-05-04T07:50:27.539831+0000","last_active":"2024-05-04T07:50:34.884037+0000","last_peered":"2024-05-04T07:50:34.884037+0000","last_clean":"2024-05-04T07:50:34.884037+0000","last_became_active":"2024-05-04T07:50:27.539289+0000","last_became_peered":"2024-05-04T07:50:27.539289+0000","last_unstale":"2024-05-04T07:50:34.884037+0000","last_undegraded":"2024-05-04T07:50:34.884037+0000","last_fullsized":"2024-05-04T07:50:34.884037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431173+0000","last_change":"2024-05-04T07:50:26.513428+0000","last_active":"2024-05-04T07:50:34.431173+0000","last_peered":"2024-05-04T07:50:34.431173+0000","last_clean":"2024-05-04T07:50:34.431173+0000","last_became_active":"2024-05-04T07:50:26.512961+0000","last_became_peered":"2024-05-04T07:50:26.512961+0000","last_unstale":"2024-05-04T07:50:34.431173+0000","last_undegraded":"2024-05-04T07:50:34.431173+0000","last_fullsized":"2024-05-04T07:50:34.431173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676160+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:50:34.676160+0000","last_peered":"2024-05-04T07:50:34.676160+0000","last_clean":"2024-05-04T07:50:34.676160+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:50:34.676160+0000","last_undegraded":"2024-05-04T07:50:34.676160+0000","last_fullsized":"2024-05-04T07:50:34.676160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576262+0000","last_change":"2024-05-04T07:50:31.754509+0000","last_active":"2024-05-04T07:50:32.576262+0000","last_peered":"2024-05-04T07:50:32.576262+0000","last_clean":"2024-05-04T07:50:32.576262+0000","last_became_active":"2024-05-04T07:50:31.751388+0000","last_became_peered":"2024-05-04T07:50:31.751388+0000","last_unstale":"2024-05-04T07:50:32.576262+0000","last_undegraded":"2024-05-04T07:50:32.576262+0000","last_fullsized":"2024-05-04T07:50:32.576262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677129+0000","last_change":"2024-05-04T07:50:27.526484+0000","last_active":"2024-05-04T07:50:34.677129+0000","last_peered":"2024-05-04T07:50:34.677129+0000","last_clean":"2024-05-04T07:50:34.677129+0000","last_became_active":"2024-05-04T07:50:27.526184+0000","last_became_peered":"2024-05-04T07:50:27.526184+0000","last_unstale":"2024-05-04T07:50:34.677129+0000","last_undegraded":"2024-05-04T07:50:34.677129+0000","last_fullsized":"2024-05-04T07:50:34.677129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571639+0000","last_change":"2024-05-04T07:50:26.511552+0000","last_active":"2024-05-04T07:50:32.571639+0000","last_peered":"2024-05-04T07:50:32.571639+0000","last_clean":"2024-05-04T07:50:32.571639+0000","last_became_active":"2024-05-04T07:50:26.510510+0000","last_became_peered":"2024-05-04T07:50:26.510510+0000","last_unstale":"2024-05-04T07:50:32.571639+0000","last_undegraded":"2024-05-04T07:50:32.571639+0000","last_fullsized":"2024-05-04T07:50:32.571639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573035+0000","last_change":"2024-05-04T07:50:31.749615+0000","last_active":"2024-05-04T07:50:32.573035+0000","last_peered":"2024-05-04T07:50:32.573035+0000","last_clean":"2024-05-04T07:50:32.573035+0000","last_became_active":"2024-05-04T07:50:31.748418+0000","last_became_peered":"2024-05-04T07:50:31.748418+0000","last_unstale":"2024-05-04T07:50:32.573035+0000","last_undegraded":"2024-05-04T07:50:32.573035+0000","last_fullsized":"2024-05-04T07:50:32.573035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431745+0000","last_change":"2024-05-04T07:50:27.533824+0000","last_active":"2024-05-04T07:50:34.431745+0000","last_peered":"2024-05-04T07:50:34.431745+0000","last_clean":"2024-05-04T07:50:34.431745+0000","last_became_active":"2024-05-04T07:50:27.533561+0000","last_became_peered":"2024-05-04T07:50:27.533561+0000","last_unstale":"2024-05-04T07:50:34.431745+0000","last_undegraded":"2024-05-04T07:50:34.431745+0000","last_fullsized":"2024-05-04T07:50:34.431745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705144+0000","last_change":"2024-05-04T07:50:26.514911+0000","last_active":"2024-05-04T07:50:34.705144+0000","last_peered":"2024-05-04T07:50:34.705144+0000","last_clean":"2024-05-04T07:50:34.705144+0000","last_became_active":"2024-05-04T07:50:26.514615+0000","last_became_peered":"2024-05-04T07:50:26.514615+0000","last_unstale":"2024-05-04T07:50:34.705144+0000","last_undegraded":"2024-05-04T07:50:34.705144+0000","last_fullsized":"2024-05-04T07:50:34.705144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907253+0000","last_change":"2024-05-04T07:50:31.568892+0000","last_active":"2024-05-04T07:50:34.907253+0000","last_peered":"2024-05-04T07:50:34.907253+0000","last_clean":"2024-05-04T07:50:34.907253+0000","last_became_active":"2024-05-04T07:50:31.568427+0000","last_became_peered":"2024-05-04T07:50:31.568427+0000","last_unstale":"2024-05-04T07:50:34.907253+0000","last_undegraded":"2024-05-04T07:50:34.907253+0000","last_fullsized":"2024-05-04T07:50:34.907253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677795+0000","last_change":"2024-05-04T07:50:27.537511+0000","last_active":"2024-05-04T07:50:34.677795+0000","last_peered":"2024-05-04T07:50:34.677795+0000","last_clean":"2024-05-04T07:50:34.677795+0000","last_became_active":"2024-05-04T07:50:27.536076+0000","last_became_peered":"2024-05-04T07:50:27.536076+0000","last_unstale":"2024-05-04T07:50:34.677795+0000","last_undegraded":"2024-05-04T07:50:34.677795+0000","last_fullsized":"2024-05-04T07:50:34.677795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:49.223933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571866+0000","last_change":"2024-05-04T07:50:26.517157+0000","last_active":"2024-05-04T07:50:32.571866+0000","last_peered":"2024-05-04T07:50:32.571866+0000","last_clean":"2024-05-04T07:50:32.571866+0000","last_became_active":"2024-05-04T07:50:26.516874+0000","last_became_peered":"2024-05-04T07:50:26.516874+0000","last_unstale":"2024-05-04T07:50:32.571866+0000","last_undegraded":"2024-05-04T07:50:32.571866+0000","last_fullsized":"2024-05-04T07:50:32.571866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430645+0000","last_change":"2024-05-04T07:50:31.760635+0000","last_active":"2024-05-04T07:50:34.430645+0000","last_peered":"2024-05-04T07:50:34.430645+0000","last_clean":"2024-05-04T07:50:34.430645+0000","last_became_active":"2024-05-04T07:50:31.757079+0000","last_became_peered":"2024-05-04T07:50:31.757079+0000","last_unstale":"2024-05-04T07:50:34.430645+0000","last_undegraded":"2024-05-04T07:50:34.430645+0000","last_fullsized":"2024-05-04T07:50:34.430645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677343+0000","last_change":"2024-05-04T07:50:27.540454+0000","last_active":"2024-05-04T07:50:34.677343+0000","last_peered":"2024-05-04T07:50:34.677343+0000","last_clean":"2024-05-04T07:50:34.677343+0000","last_became_active":"2024-05-04T07:50:27.540144+0000","last_became_peered":"2024-05-04T07:50:27.540144+0000","last_unstale":"2024-05-04T07:50:34.677343+0000","last_undegraded":"2024-05-04T07:50:34.677343+0000","last_fullsized":"2024-05-04T07:50:34.677343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577699+0000","last_change":"2024-05-04T07:50:26.503229+0000","last_active":"2024-05-04T07:50:32.577699+0000","last_peered":"2024-05-04T07:50:32.577699+0000","last_clean":"2024-05-04T07:50:32.577699+0000","last_became_active":"2024-05-04T07:50:26.502831+0000","last_became_peered":"2024-05-04T07:50:26.502831+0000","last_unstale":"2024-05-04T07:50:32.577699+0000","last_undegraded":"2024-05-04T07:50:32.577699+0000","last_fullsized":"2024-05-04T07:50:32.577699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:08:59.681592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575067+0000","last_change":"2024-05-04T07:50:31.575538+0000","last_active":"2024-05-04T07:50:32.575067+0000","last_peered":"2024-05-04T07:50:32.575067+0000","last_clean":"2024-05-04T07:50:32.575067+0000","last_became_active":"2024-05-04T07:50:31.575246+0000","last_became_peered":"2024-05-04T07:50:31.575246+0000","last_unstale":"2024-05-04T07:50:32.575067+0000","last_undegraded":"2024-05-04T07:50:32.575067+0000","last_fullsized":"2024-05-04T07:50:32.575067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:59.402800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676420+0000","last_change":"2024-05-04T07:50:27.522684+0000","last_active":"2024-05-04T07:50:34.676420+0000","last_peered":"2024-05-04T07:50:34.676420+0000","last_clean":"2024-05-04T07:50:34.676420+0000","last_became_active":"2024-05-04T07:50:27.522411+0000","last_became_peered":"2024-05-04T07:50:27.522411+0000","last_unstale":"2024-05-04T07:50:34.676420+0000","last_undegraded":"2024-05-04T07:50:34.676420+0000","last_fullsized":"2024-05-04T07:50:34.676420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570481+0000","last_change":"2024-05-04T07:50:26.506955+0000","last_active":"2024-05-04T07:50:32.570481+0000","last_peered":"2024-05-04T07:50:32.570481+0000","last_clean":"2024-05-04T07:50:32.570481+0000","last_became_active":"2024-05-04T07:50:26.506608+0000","last_became_peered":"2024-05-04T07:50:26.506608+0000","last_unstale":"2024-05-04T07:50:32.570481+0000","last_undegraded":"2024-05-04T07:50:32.570481+0000","last_fullsized":"2024-05-04T07:50:32.570481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907170+0000","last_change":"2024-05-04T07:50:31.555725+0000","last_active":"2024-05-04T07:50:34.907170+0000","last_peered":"2024-05-04T07:50:34.907170+0000","last_clean":"2024-05-04T07:50:34.907170+0000","last_became_active":"2024-05-04T07:50:31.555270+0000","last_became_peered":"2024-05-04T07:50:31.555270+0000","last_unstale":"2024-05-04T07:50:34.907170+0000","last_undegraded":"2024-05-04T07:50:34.907170+0000","last_fullsized":"2024-05-04T07:50:34.907170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:44.773246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573323+0000","last_change":"2024-05-04T07:50:27.518477+0000","last_active":"2024-05-04T07:50:32.573323+0000","last_peered":"2024-05-04T07:50:32.573323+0000","last_clean":"2024-05-04T07:50:32.573323+0000","last_became_active":"2024-05-04T07:50:27.517791+0000","last_became_peered":"2024-05-04T07:50:27.517791+0000","last_unstale":"2024-05-04T07:50:32.573323+0000","last_undegraded":"2024-05-04T07:50:32.573323+0000","last_fullsized":"2024-05-04T07:50:32.573323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573574+0000","last_change":"2024-05-04T07:50:26.510434+0000","last_active":"2024-05-04T07:50:32.573574+0000","last_peered":"2024-05-04T07:50:32.573574+0000","last_clean":"2024-05-04T07:50:32.573574+0000","last_became_active":"2024-05-04T07:50:26.510119+0000","last_became_peered":"2024-05-04T07:50:26.510119+0000","last_unstale":"2024-05-04T07:50:32.573574+0000","last_undegraded":"2024-05-04T07:50:32.573574+0000","last_fullsized":"2024-05-04T07:50:32.573574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885212+0000","last_change":"2024-05-04T07:50:31.756666+0000","last_active":"2024-05-04T07:50:34.885212+0000","last_peered":"2024-05-04T07:50:34.885212+0000","last_clean":"2024-05-04T07:50:34.885212+0000","last_became_active":"2024-05-04T07:50:31.756249+0000","last_became_peered":"2024-05-04T07:50:31.756249+0000","last_unstale":"2024-05-04T07:50:34.885212+0000","last_undegraded":"2024-05-04T07:50:34.885212+0000","last_fullsized":"2024-05-04T07:50:34.885212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:37:24.803569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676890+0000","last_change":"2024-05-04T07:50:27.540674+0000","last_active":"2024-05-04T07:50:34.676890+0000","last_peered":"2024-05-04T07:50:34.676890+0000","last_clean":"2024-05-04T07:50:34.676890+0000","last_became_active":"2024-05-04T07:50:27.540424+0000","last_became_peered":"2024-05-04T07:50:27.540424+0000","last_unstale":"2024-05-04T07:50:34.676890+0000","last_undegraded":"2024-05-04T07:50:34.676890+0000","last_fullsized":"2024-05-04T07:50:34.676890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431291+0000","last_change":"2024-05-04T07:50:26.523666+0000","last_active":"2024-05-04T07:50:34.431291+0000","last_peered":"2024-05-04T07:50:34.431291+0000","last_clean":"2024-05-04T07:50:34.431291+0000","last_became_active":"2024-05-04T07:50:26.522969+0000","last_became_peered":"2024-05-04T07:50:26.522969+0000","last_unstale":"2024-05-04T07:50:34.431291+0000","last_undegraded":"2024-05-04T07:50:34.431291+0000","last_fullsized":"2024-05-04T07:50:34.431291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:51.372178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884708+0000","last_change":"2024-05-04T07:50:31.748030+0000","last_active":"2024-05-04T07:50:34.884708+0000","last_peered":"2024-05-04T07:50:34.884708+0000","last_clean":"2024-05-04T07:50:34.884708+0000","last_became_active":"2024-05-04T07:50:31.746933+0000","last_became_peered":"2024-05-04T07:50:31.746933+0000","last_unstale":"2024-05-04T07:50:34.884708+0000","last_undegraded":"2024-05-04T07:50:34.884708+0000","last_fullsized":"2024-05-04T07:50:34.884708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:09:59.415101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906640+0000","last_change":"2024-05-04T07:50:27.527928+0000","last_active":"2024-05-04T07:50:34.906640+0000","last_peered":"2024-05-04T07:50:34.906640+0000","last_clean":"2024-05-04T07:50:34.906640+0000","last_became_active":"2024-05-04T07:50:27.527533+0000","last_became_peered":"2024-05-04T07:50:27.527533+0000","last_unstale":"2024-05-04T07:50:34.906640+0000","last_undegraded":"2024-05-04T07:50:34.906640+0000","last_fullsized":"2024-05-04T07:50:34.906640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.905602+0000","last_change":"2024-05-04T07:50:26.513336+0000","last_active":"2024-05-04T07:50:34.905602+0000","last_peered":"2024-05-04T07:50:34.905602+0000","last_clean":"2024-05-04T07:50:34.905602+0000","last_became_active":"2024-05-04T07:50:26.512985+0000","last_became_peered":"2024-05-04T07:50:26.512985+0000","last_unstale":"2024-05-04T07:50:34.905602+0000","last_undegraded":"2024-05-04T07:50:34.905602+0000","last_fullsized":"2024-05-04T07:50:34.905602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:06.202371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432021+0000","last_change":"2024-05-04T07:50:31.749461+0000","last_active":"2024-05-04T07:50:34.432021+0000","last_peered":"2024-05-04T07:50:34.432021+0000","last_clean":"2024-05-04T07:50:34.432021+0000","last_became_active":"2024-05-04T07:50:31.748351+0000","last_became_peered":"2024-05-04T07:50:31.748351+0000","last_unstale":"2024-05-04T07:50:34.432021+0000","last_undegraded":"2024-05-04T07:50:34.432021+0000","last_fullsized":"2024-05-04T07:50:34.432021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676838+0000","last_change":"2024-05-04T07:50:27.521782+0000","last_active":"2024-05-04T07:50:34.676838+0000","last_peered":"2024-05-04T07:50:34.676838+0000","last_clean":"2024-05-04T07:50:34.676838+0000","last_became_active":"2024-05-04T07:50:27.521501+0000","last_became_peered":"2024-05-04T07:50:27.521501+0000","last_unstale":"2024-05-04T07:50:34.676838+0000","last_undegraded":"2024-05-04T07:50:34.676838+0000","last_fullsized":"2024-05-04T07:50:34.676838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:39.662272+0000","last_change":"2024-05-04T07:50:26.523082+0000","last_active":"2024-05-04T07:50:39.662272+0000","last_peered":"2024-05-04T07:50:39.662272+0000","last_clean":"2024-05-04T07:50:39.662272+0000","last_became_active":"2024-05-04T07:50:26.522745+0000","last_became_peered":"2024-05-04T07:50:26.522745+0000","last_unstale":"2024-05-04T07:50:39.662272+0000","last_undegraded":"2024-05-04T07:50:39.662272+0000","last_fullsized":"2024-05-04T07:50:39.662272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706176+0000","last_change":"2024-05-04T07:50:31.564157+0000","last_active":"2024-05-04T07:50:34.706176+0000","last_peered":"2024-05-04T07:50:34.706176+0000","last_clean":"2024-05-04T07:50:34.706176+0000","last_became_active":"2024-05-04T07:50:31.563164+0000","last_became_peered":"2024-05-04T07:50:31.563164+0000","last_unstale":"2024-05-04T07:50:34.706176+0000","last_undegraded":"2024-05-04T07:50:34.706176+0000","last_fullsized":"2024-05-04T07:50:34.706176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575072+0000","last_change":"2024-05-04T07:50:27.525542+0000","last_active":"2024-05-04T07:50:32.575072+0000","last_peered":"2024-05-04T07:50:32.575072+0000","last_clean":"2024-05-04T07:50:32.575072+0000","last_became_active":"2024-05-04T07:50:27.525248+0000","last_became_peered":"2024-05-04T07:50:27.525248+0000","last_unstale":"2024-05-04T07:50:32.575072+0000","last_undegraded":"2024-05-04T07:50:32.575072+0000","last_fullsized":"2024-05-04T07:50:32.575072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:28.619214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705230+0000","last_change":"2024-05-04T07:50:26.518937+0000","last_active":"2024-05-04T07:50:34.705230+0000","last_peered":"2024-05-04T07:50:34.705230+0000","last_clean":"2024-05-04T07:50:34.705230+0000","last_became_active":"2024-05-04T07:50:26.518493+0000","last_became_peered":"2024-05-04T07:50:26.518493+0000","last_unstale":"2024-05-04T07:50:34.705230+0000","last_undegraded":"2024-05-04T07:50:34.705230+0000","last_fullsized":"2024-05-04T07:50:34.705230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575567+0000","last_change":"2024-05-04T07:50:31.568993+0000","last_active":"2024-05-04T07:50:32.575567+0000","last_peered":"2024-05-04T07:50:32.575567+0000","last_clean":"2024-05-04T07:50:32.575567+0000","last_became_active":"2024-05-04T07:50:31.568477+0000","last_became_peered":"2024-05-04T07:50:31.568477+0000","last_unstale":"2024-05-04T07:50:32.575567+0000","last_undegraded":"2024-05-04T07:50:32.575567+0000","last_fullsized":"2024-05-04T07:50:32.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:23.224976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908175+0000","last_change":"2024-05-04T07:50:27.532480+0000","last_active":"2024-05-04T07:50:34.908175+0000","last_peered":"2024-05-04T07:50:34.908175+0000","last_clean":"2024-05-04T07:50:34.908175+0000","last_became_active":"2024-05-04T07:50:27.532194+0000","last_became_peered":"2024-05-04T07:50:27.532194+0000","last_unstale":"2024-05-04T07:50:34.908175+0000","last_undegraded":"2024-05-04T07:50:34.908175+0000","last_fullsized":"2024-05-04T07:50:34.908175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432284+0000","last_change":"2024-05-04T07:50:26.517065+0000","last_active":"2024-05-04T07:50:34.432284+0000","last_peered":"2024-05-04T07:50:34.432284+0000","last_clean":"2024-05-04T07:50:34.432284+0000","last_became_active":"2024-05-04T07:50:26.516714+0000","last_became_peered":"2024-05-04T07:50:26.516714+0000","last_unstale":"2024-05-04T07:50:34.432284+0000","last_undegraded":"2024-05-04T07:50:34.432284+0000","last_fullsized":"2024-05-04T07:50:34.432284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883217+0000","last_change":"2024-05-04T07:50:31.561005+0000","last_active":"2024-05-04T07:50:34.883217+0000","last_peered":"2024-05-04T07:50:34.883217+0000","last_clean":"2024-05-04T07:50:34.883217+0000","last_became_active":"2024-05-04T07:50:31.560530+0000","last_became_peered":"2024-05-04T07:50:31.560530+0000","last_unstale":"2024-05-04T07:50:34.883217+0000","last_undegraded":"2024-05-04T07:50:34.883217+0000","last_fullsized":"2024-05-04T07:50:34.883217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431967+0000","last_change":"2024-05-04T07:50:27.527644+0000","last_active":"2024-05-04T07:50:34.431967+0000","last_peered":"2024-05-04T07:50:34.431967+0000","last_clean":"2024-05-04T07:50:34.431967+0000","last_became_active":"2024-05-04T07:50:27.527144+0000","last_became_peered":"2024-05-04T07:50:27.527144+0000","last_unstale":"2024-05-04T07:50:34.431967+0000","last_undegraded":"2024-05-04T07:50:34.431967+0000","last_fullsized":"2024-05-04T07:50:34.431967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577526+0000","last_change":"2024-05-04T07:50:26.513482+0000","last_active":"2024-05-04T07:50:32.577526+0000","last_peered":"2024-05-04T07:50:32.577526+0000","last_clean":"2024-05-04T07:50:32.577526+0000","last_became_active":"2024-05-04T07:50:26.513184+0000","last_became_peered":"2024-05-04T07:50:26.513184+0000","last_unstale":"2024-05-04T07:50:32.577526+0000","last_undegraded":"2024-05-04T07:50:32.577526+0000","last_fullsized":"2024-05-04T07:50:32.577526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883725+0000","last_change":"2024-05-04T07:50:31.758024+0000","last_active":"2024-05-04T07:50:34.883725+0000","last_peered":"2024-05-04T07:50:34.883725+0000","last_clean":"2024-05-04T07:50:34.883725+0000","last_became_active":"2024-05-04T07:50:31.756399+0000","last_became_peered":"2024-05-04T07:50:31.756399+0000","last_unstale":"2024-05-04T07:50:34.883725+0000","last_undegraded":"2024-05-04T07:50:34.883725+0000","last_fullsized":"2024-05-04T07:50:34.883725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907003+0000","last_change":"2024-05-04T07:50:31.757980+0000","last_active":"2024-05-04T07:50:34.907003+0000","last_peered":"2024-05-04T07:50:34.907003+0000","last_clean":"2024-05-04T07:50:34.907003+0000","last_became_active":"2024-05-04T07:50:31.756577+0000","last_became_peered":"2024-05-04T07:50:31.756577+0000","last_unstale":"2024-05-04T07:50:34.907003+0000","last_undegraded":"2024-05-04T07:50:34.907003+0000","last_fullsized":"2024-05-04T07:50:34.907003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:37.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705484+0000","last_change":"2024-05-04T07:50:27.513707+0000","last_active":"2024-05-04T07:50:34.705484+0000","last_peered":"2024-05-04T07:50:34.705484+0000","last_clean":"2024-05-04T07:50:34.705484+0000","last_became_active":"2024-05-04T07:50:27.513407+0000","last_became_peered":"2024-05-04T07:50:27.513407+0000","last_unstale":"2024-05-04T07:50:34.705484+0000","last_undegraded":"2024-05-04T07:50:34.705484+0000","last_fullsized":"2024-05-04T07:50:34.705484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431437+0000","last_change":"2024-05-04T07:50:26.521863+0000","last_active":"2024-05-04T07:50:34.431437+0000","last_peered":"2024-05-04T07:50:34.431437+0000","last_clean":"2024-05-04T07:50:34.431437+0000","last_became_active":"2024-05-04T07:50:26.521362+0000","last_became_peered":"2024-05-04T07:50:26.521362+0000","last_unstale":"2024-05-04T07:50:34.431437+0000","last_undegraded":"2024-05-04T07:50:34.431437+0000","last_fullsized":"2024-05-04T07:50:34.431437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577533+0000","last_change":"2024-05-04T07:50:31.567080+0000","last_active":"2024-05-04T07:50:32.577533+0000","last_peered":"2024-05-04T07:50:32.577533+0000","last_clean":"2024-05-04T07:50:32.577533+0000","last_became_active":"2024-05-04T07:50:31.566643+0000","last_became_peered":"2024-05-04T07:50:31.566643+0000","last_unstale":"2024-05-04T07:50:32.577533+0000","last_undegraded":"2024-05-04T07:50:32.577533+0000","last_fullsized":"2024-05-04T07:50:32.577533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883291+0000","last_change":"2024-05-04T07:50:27.517785+0000","last_active":"2024-05-04T07:50:34.883291+0000","last_peered":"2024-05-04T07:50:34.883291+0000","last_clean":"2024-05-04T07:50:34.883291+0000","last_became_active":"2024-05-04T07:50:27.517532+0000","last_became_peered":"2024-05-04T07:50:27.517532+0000","last_unstale":"2024-05-04T07:50:34.883291+0000","last_undegraded":"2024-05-04T07:50:34.883291+0000","last_fullsized":"2024-05-04T07:50:34.883291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882248+0000","last_change":"2024-05-04T07:50:26.516109+0000","last_active":"2024-05-04T07:50:34.882248+0000","last_peered":"2024-05-04T07:50:34.882248+0000","last_clean":"2024-05-04T07:50:34.882248+0000","last_became_active":"2024-05-04T07:50:26.515518+0000","last_became_peered":"2024-05-04T07:50:26.515518+0000","last_unstale":"2024-05-04T07:50:34.882248+0000","last_undegraded":"2024-05-04T07:50:34.882248+0000","last_fullsized":"2024-05-04T07:50:34.882248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575304+0000","last_change":"2024-05-04T07:50:26.509275+0000","last_active":"2024-05-04T07:50:32.575304+0000","last_peered":"2024-05-04T07:50:32.575304+0000","last_clean":"2024-05-04T07:50:32.575304+0000","last_became_active":"2024-05-04T07:50:26.505492+0000","last_became_peered":"2024-05-04T07:50:26.505492+0000","last_unstale":"2024-05-04T07:50:32.575304+0000","last_undegraded":"2024-05-04T07:50:32.575304+0000","last_fullsized":"2024-05-04T07:50:32.575304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907512+0000","last_change":"2024-05-04T07:50:27.514230+0000","last_active":"2024-05-04T07:50:34.907512+0000","last_peered":"2024-05-04T07:50:34.907512+0000","last_clean":"2024-05-04T07:50:34.907512+0000","last_became_active":"2024-05-04T07:50:27.512993+0000","last_became_peered":"2024-05-04T07:50:27.512993+0000","last_unstale":"2024-05-04T07:50:34.907512+0000","last_undegraded":"2024-05-04T07:50:34.907512+0000","last_fullsized":"2024-05-04T07:50:34.907512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571374+0000","last_change":"2024-05-04T07:50:31.565560+0000","last_active":"2024-05-04T07:50:32.571374+0000","last_peered":"2024-05-04T07:50:32.571374+0000","last_clean":"2024-05-04T07:50:32.571374+0000","last_became_active":"2024-05-04T07:50:31.564371+0000","last_became_peered":"2024-05-04T07:50:31.564371+0000","last_unstale":"2024-05-04T07:50:32.571374+0000","last_undegraded":"2024-05-04T07:50:32.571374+0000","last_fullsized":"2024-05-04T07:50:32.571374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:16.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884400+0000","last_change":"2024-05-04T07:50:26.516509+0000","last_active":"2024-05-04T07:50:34.884400+0000","last_peered":"2024-05-04T07:50:34.884400+0000","last_clean":"2024-05-04T07:50:34.884400+0000","last_became_active":"2024-05-04T07:50:26.516120+0000","last_became_peered":"2024-05-04T07:50:26.516120+0000","last_unstale":"2024-05-04T07:50:34.884400+0000","last_undegraded":"2024-05-04T07:50:34.884400+0000","last_fullsized":"2024-05-04T07:50:34.884400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574616+0000","last_change":"2024-05-04T07:50:27.515095+0000","last_active":"2024-05-04T07:50:32.574616+0000","last_peered":"2024-05-04T07:50:32.574616+0000","last_clean":"2024-05-04T07:50:32.574616+0000","last_became_active":"2024-05-04T07:50:27.514715+0000","last_became_peered":"2024-05-04T07:50:27.514715+0000","last_unstale":"2024-05-04T07:50:32.574616+0000","last_undegraded":"2024-05-04T07:50:32.574616+0000","last_fullsized":"2024-05-04T07:50:32.574616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:19:00.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884950+0000","last_change":"2024-05-04T07:50:31.561861+0000","last_active":"2024-05-04T07:50:34.884950+0000","last_peered":"2024-05-04T07:50:34.884950+0000","last_clean":"2024-05-04T07:50:34.884950+0000","last_became_active":"2024-05-04T07:50:31.561513+0000","last_became_peered":"2024-05-04T07:50:31.561513+0000","last_unstale":"2024-05-04T07:50:34.884950+0000","last_undegraded":"2024-05-04T07:50:34.884950+0000","last_fullsized":"2024-05-04T07:50:34.884950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:47:50.794538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.572760+0000","last_change":"2024-05-04T07:50:27.518744+0000","last_active":"2024-05-04T07:50:32.572760+0000","last_peered":"2024-05-04T07:50:32.572760+0000","last_clean":"2024-05-04T07:50:32.572760+0000","last_became_active":"2024-05-04T07:50:27.518199+0000","last_became_peered":"2024-05-04T07:50:27.518199+0000","last_unstale":"2024-05-04T07:50:32.572760+0000","last_undegraded":"2024-05-04T07:50:32.572760+0000","last_fullsized":"2024-05-04T07:50:32.572760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570708+0000","last_change":"2024-05-04T07:50:27.523376+0000","last_active":"2024-05-04T07:50:32.570708+0000","last_peered":"2024-05-04T07:50:32.570708+0000","last_clean":"2024-05-04T07:50:32.570708+0000","last_became_active":"2024-05-04T07:50:27.523130+0000","last_became_peered":"2024-05-04T07:50:27.523130+0000","last_unstale":"2024-05-04T07:50:32.570708+0000","last_undegraded":"2024-05-04T07:50:32.570708+0000","last_fullsized":"2024-05-04T07:50:32.570708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431205+0000","last_change":"2024-05-04T07:50:27.530509+0000","last_active":"2024-05-04T07:50:34.431205+0000","last_peered":"2024-05-04T07:50:34.431205+0000","last_clean":"2024-05-04T07:50:34.431205+0000","last_became_active":"2024-05-04T07:50:27.515836+0000","last_became_peered":"2024-05-04T07:50:27.515836+0000","last_unstale":"2024-05-04T07:50:34.431205+0000","last_undegraded":"2024-05-04T07:50:34.431205+0000","last_fullsized":"2024-05-04T07:50:34.431205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907284+0000","last_change":"2024-05-04T07:50:27.514059+0000","last_active":"2024-05-04T07:50:34.907284+0000","last_peered":"2024-05-04T07:50:34.907284+0000","last_clean":"2024-05-04T07:50:34.907284+0000","last_became_active":"2024-05-04T07:50:27.513683+0000","last_became_peered":"2024-05-04T07:50:27.513683+0000","last_unstale":"2024-05-04T07:50:34.907284+0000","last_undegraded":"2024-05-04T07:50:34.907284+0000","last_fullsized":"2024-05-04T07:50:34.907284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884958+0000","last_change":"2024-05-04T07:50:27.512681+0000","last_active":"2024-05-04T07:50:34.884958+0000","last_peered":"2024-05-04T07:50:34.884958+0000","last_clean":"2024-05-04T07:50:34.884958+0000","last_became_active":"2024-05-04T07:50:27.512396+0000","last_became_peered":"2024-05-04T07:50:27.512396+0000","last_unstale":"2024-05-04T07:50:34.884958+0000","last_undegraded":"2024-05-04T07:50:34.884958+0000","last_fullsized":"2024-05-04T07:50:34.884958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706559+0000","last_change":"2024-05-04T07:50:27.513740+0000","last_active":"2024-05-04T07:50:34.706559+0000","last_peered":"2024-05-04T07:50:34.706559+0000","last_clean":"2024-05-04T07:50:34.706559+0000","last_became_active":"2024-05-04T07:50:27.513429+0000","last_became_peered":"2024-05-04T07:50:27.513429+0000","last_unstale":"2024-05-04T07:50:34.706559+0000","last_undegraded":"2024-05-04T07:50:34.706559+0000","last_fullsized":"2024-05-04T07:50:34.706559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578213+0000","last_change":"2024-05-04T07:50:27.523815+0000","last_active":"2024-05-04T07:50:32.578213+0000","last_peered":"2024-05-04T07:50:32.578213+0000","last_clean":"2024-05-04T07:50:32.578213+0000","last_became_active":"2024-05-04T07:50:27.520965+0000","last_became_peered":"2024-05-04T07:50:27.520965+0000","last_unstale":"2024-05-04T07:50:32.578213+0000","last_undegraded":"2024-05-04T07:50:32.578213+0000","last_fullsized":"2024-05-04T07:50:32.578213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885181+0000","last_change":"2024-05-04T07:50:27.512542+0000","last_active":"2024-05-04T07:50:34.885181+0000","last_peered":"2024-05-04T07:50:34.885181+0000","last_clean":"2024-05-04T07:50:34.885181+0000","last_became_active":"2024-05-04T07:50:27.511791+0000","last_became_peered":"2024-05-04T07:50:27.511791+0000","last_unstale":"2024-05-04T07:50:34.885181+0000","last_undegraded":"2024-05-04T07:50:34.885181+0000","last_fullsized":"2024-05-04T07:50:34.885181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431166+0000","last_change":"2024-05-04T07:50:27.525062+0000","last_active":"2024-05-04T07:50:34.431166+0000","last_peered":"2024-05-04T07:50:34.431166+0000","last_clean":"2024-05-04T07:50:34.431166+0000","last_became_active":"2024-05-04T07:50:27.523669+0000","last_became_peered":"2024-05-04T07:50:27.523669+0000","last_unstale":"2024-05-04T07:50:34.431166+0000","last_undegraded":"2024-05-04T07:50:34.431166+0000","last_fullsized":"2024-05-04T07:50:34.431166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883783+0000","last_change":"2024-05-04T07:50:27.529011+0000","last_active":"2024-05-04T07:50:34.883783+0000","last_peered":"2024-05-04T07:50:34.883783+0000","last_clean":"2024-05-04T07:50:34.883783+0000","last_became_active":"2024-05-04T07:50:27.518430+0000","last_became_peered":"2024-05-04T07:50:27.518430+0000","last_unstale":"2024-05-04T07:50:34.883783+0000","last_undegraded":"2024-05-04T07:50:34.883783+0000","last_fullsized":"2024-05-04T07:50:34.883783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431100+0000","last_change":"2024-05-04T07:50:27.535855+0000","last_active":"2024-05-04T07:50:34.431100+0000","last_peered":"2024-05-04T07:50:34.431100+0000","last_clean":"2024-05-04T07:50:34.431100+0000","last_became_active":"2024-05-04T07:50:27.535085+0000","last_became_peered":"2024-05-04T07:50:27.535085+0000","last_unstale":"2024-05-04T07:50:34.431100+0000","last_undegraded":"2024-05-04T07:50:34.431100+0000","last_fullsized":"2024-05-04T07:50:34.431100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906800+0000","last_change":"2024-05-04T07:50:27.517267+0000","last_active":"2024-05-04T07:50:34.906800+0000","last_peered":"2024-05-04T07:50:34.906800+0000","last_clean":"2024-05-04T07:50:34.906800+0000","last_became_active":"2024-05-04T07:50:27.516417+0000","last_became_peered":"2024-05-04T07:50:27.516417+0000","last_unstale":"2024-05-04T07:50:34.906800+0000","last_undegraded":"2024-05-04T07:50:34.906800+0000","last_fullsized":"2024-05-04T07:50:34.906800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576402+0000","last_change":"2024-05-04T07:50:27.532237+0000","last_active":"2024-05-04T07:50:32.576402+0000","last_peered":"2024-05-04T07:50:32.576402+0000","last_clean":"2024-05-04T07:50:32.576402+0000","last_became_active":"2024-05-04T07:50:27.530803+0000","last_became_peered":"2024-05-04T07:50:27.530803+0000","last_unstale":"2024-05-04T07:50:32.576402+0000","last_undegraded":"2024-05-04T07:50:32.576402+0000","last_fullsized":"2024-05-04T07:50:32.576402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677498+0000","last_change":"2024-05-04T07:50:27.521954+0000","last_active":"2024-05-04T07:50:34.677498+0000","last_peered":"2024-05-04T07:50:34.677498+0000","last_clean":"2024-05-04T07:50:34.677498+0000","last_became_active":"2024-05-04T07:50:27.521647+0000","last_became_peered":"2024-05-04T07:50:27.521647+0000","last_unstale":"2024-05-04T07:50:34.677498+0000","last_undegraded":"2024-05-04T07:50:34.677498+0000","last_fullsized":"2024-05-04T07:50:34.677498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571683+0000","last_change":"2024-05-04T07:50:27.514465+0000","last_active":"2024-05-04T07:50:32.571683+0000","last_peered":"2024-05-04T07:50:32.571683+0000","last_clean":"2024-05-04T07:50:32.571683+0000","last_became_active":"2024-05-04T07:50:27.514167+0000","last_became_peered":"2024-05-04T07:50:27.514167+0000","last_unstale":"2024-05-04T07:50:32.571683+0000","last_undegraded":"2024-05-04T07:50:32.571683+0000","last_fullsized":"2024-05-04T07:50:32.571683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:17.663860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432381+0000","last_change":"2024-05-04T07:50:27.532760+0000","last_active":"2024-05-04T07:50:34.432381+0000","last_peered":"2024-05-04T07:50:34.432381+0000","last_clean":"2024-05-04T07:50:34.432381+0000","last_became_active":"2024-05-04T07:50:27.532227+0000","last_became_peered":"2024-05-04T07:50:27.532227+0000","last_unstale":"2024-05-04T07:50:34.432381+0000","last_undegraded":"2024-05-04T07:50:34.432381+0000","last_fullsized":"2024-05-04T07:50:34.432381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430627+0000","last_change":"2024-05-04T07:50:27.526544+0000","last_active":"2024-05-04T07:50:34.430627+0000","last_peered":"2024-05-04T07:50:34.430627+0000","last_clean":"2024-05-04T07:50:34.430627+0000","last_became_active":"2024-05-04T07:50:27.523814+0000","last_became_peered":"2024-05-04T07:50:27.523814+0000","last_unstale":"2024-05-04T07:50:34.430627+0000","last_undegraded":"2024-05-04T07:50:34.430627+0000","last_fullsized":"2024-05-04T07:50:34.430627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705529+0000","last_change":"2024-05-04T07:50:27.520067+0000","last_active":"2024-05-04T07:50:34.705529+0000","last_peered":"2024-05-04T07:50:34.705529+0000","last_clean":"2024-05-04T07:50:34.705529+0000","last_became_active":"2024-05-04T07:50:27.519793+0000","last_became_peered":"2024-05-04T07:50:27.519793+0000","last_unstale":"2024-05-04T07:50:34.705529+0000","last_undegraded":"2024-05-04T07:50:34.705529+0000","last_fullsized":"2024-05-04T07:50:34.705529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906569+0000","last_change":"2024-05-04T07:50:27.519351+0000","last_active":"2024-05-04T07:50:34.906569+0000","last_peered":"2024-05-04T07:50:34.906569+0000","last_clean":"2024-05-04T07:50:34.906569+0000","last_became_active":"2024-05-04T07:50:27.519113+0000","last_became_peered":"2024-05-04T07:50:27.519113+0000","last_unstale":"2024-05-04T07:50:34.906569+0000","last_undegraded":"2024-05-04T07:50:34.906569+0000","last_fullsized":"2024-05-04T07:50:34.906569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:08.397148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884191+0000","last_change":"2024-05-04T07:50:27.512150+0000","last_active":"2024-05-04T07:50:34.884191+0000","last_peered":"2024-05-04T07:50:34.884191+0000","last_clean":"2024-05-04T07:50:34.884191+0000","last_became_active":"2024-05-04T07:50:27.511803+0000","last_became_peered":"2024-05-04T07:50:27.511803+0000","last_unstale":"2024-05-04T07:50:34.884191+0000","last_undegraded":"2024-05-04T07:50:34.884191+0000","last_fullsized":"2024-05-04T07:50:34.884191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574754+0000","last_change":"2024-05-04T07:50:27.515638+0000","last_active":"2024-05-04T07:50:32.574754+0000","last_peered":"2024-05-04T07:50:32.574754+0000","last_clean":"2024-05-04T07:50:32.574754+0000","last_became_active":"2024-05-04T07:50:27.515369+0000","last_became_peered":"2024-05-04T07:50:27.515369+0000","last_unstale":"2024-05-04T07:50:32.574754+0000","last_undegraded":"2024-05-04T07:50:32.574754+0000","last_fullsized":"2024-05-04T07:50:32.574754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577020+0000","last_change":"2024-05-04T07:50:27.526027+0000","last_active":"2024-05-04T07:50:32.577020+0000","last_peered":"2024-05-04T07:50:32.577020+0000","last_clean":"2024-05-04T07:50:32.577020+0000","last_became_active":"2024-05-04T07:50:27.525765+0000","last_became_peered":"2024-05-04T07:50:27.525765+0000","last_unstale":"2024-05-04T07:50:32.577020+0000","last_undegraded":"2024-05-04T07:50:32.577020+0000","last_fullsized":"2024-05-04T07:50:32.577020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578172+0000","last_change":"2024-05-04T07:50:27.528920+0000","last_active":"2024-05-04T07:50:32.578172+0000","last_peered":"2024-05-04T07:50:32.578172+0000","last_clean":"2024-05-04T07:50:32.578172+0000","last_became_active":"2024-05-04T07:50:27.528633+0000","last_became_peered":"2024-05-04T07:50:27.528633+0000","last_unstale":"2024-05-04T07:50:32.578172+0000","last_undegraded":"2024-05-04T07:50:32.578172+0000","last_fullsized":"2024-05-04T07:50:32.578172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677737+0000","last_change":"2024-05-04T07:50:27.539050+0000","last_active":"2024-05-04T07:50:34.677737+0000","last_peered":"2024-05-04T07:50:34.677737+0000","last_clean":"2024-05-04T07:50:34.677737+0000","last_became_active":"2024-05-04T07:50:27.538566+0000","last_became_peered":"2024-05-04T07:50:27.538566+0000","last_unstale":"2024-05-04T07:50:34.677737+0000","last_undegraded":"2024-05-04T07:50:34.677737+0000","last_fullsized":"2024-05-04T07:50:34.677737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:00.280798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882986+0000","last_change":"2024-05-04T07:50:27.530248+0000","last_active":"2024-05-04T07:50:34.882986+0000","last_peered":"2024-05-04T07:50:34.882986+0000","last_clean":"2024-05-04T07:50:34.882986+0000","last_became_active":"2024-05-04T07:50:27.529931+0000","last_became_peered":"2024-05-04T07:50:27.529931+0000","last_unstale":"2024-05-04T07:50:34.882986+0000","last_undegraded":"2024-05-04T07:50:34.882986+0000","last_fullsized":"2024-05-04T07:50:34.882986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676252+0000","last_change":"2024-05-04T07:50:27.529562+0000","last_active":"2024-05-04T07:50:34.676252+0000","last_peered":"2024-05-04T07:50:34.676252+0000","last_clean":"2024-05-04T07:50:34.676252+0000","last_became_active":"2024-05-04T07:50:27.526146+0000","last_became_peered":"2024-05-04T07:50:27.526146+0000","last_unstale":"2024-05-04T07:50:34.676252+0000","last_undegraded":"2024-05-04T07:50:34.676252+0000","last_fullsized":"2024-05-04T07:50:34.676252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430913+0000","last_change":"2024-05-04T07:50:27.535474+0000","last_active":"2024-05-04T07:50:34.430913+0000","last_peered":"2024-05-04T07:50:34.430913+0000","last_clean":"2024-05-04T07:50:34.430913+0000","last_became_active":"2024-05-04T07:50:27.534280+0000","last_became_peered":"2024-05-04T07:50:27.534280+0000","last_unstale":"2024-05-04T07:50:34.430913+0000","last_undegraded":"2024-05-04T07:50:34.430913+0000","last_fullsized":"2024-05-04T07:50:34.430913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676579+0000","last_change":"2024-05-04T07:50:27.535375+0000","last_active":"2024-05-04T07:50:34.676579+0000","last_peered":"2024-05-04T07:50:34.676579+0000","last_clean":"2024-05-04T07:50:34.676579+0000","last_became_active":"2024-05-04T07:50:27.535098+0000","last_became_peered":"2024-05-04T07:50:27.535098+0000","last_unstale":"2024-05-04T07:50:34.676579+0000","last_undegraded":"2024-05-04T07:50:34.676579+0000","last_fullsized":"2024-05-04T07:50:34.676579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431426+0000","last_change":"2024-05-04T07:50:27.524844+0000","last_active":"2024-05-04T07:50:34.431426+0000","last_peered":"2024-05-04T07:50:34.431426+0000","last_clean":"2024-05-04T07:50:34.431426+0000","last_became_active":"2024-05-04T07:50:27.516441+0000","last_became_peered":"2024-05-04T07:50:27.516441+0000","last_unstale":"2024-05-04T07:50:34.431426+0000","last_undegraded":"2024-05-04T07:50:34.431426+0000","last_fullsized":"2024-05-04T07:50:34.431426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907140+0000","last_change":"2024-05-04T07:50:27.510561+0000","last_active":"2024-05-04T07:50:34.907140+0000","last_peered":"2024-05-04T07:50:34.907140+0000","last_clean":"2024-05-04T07:50:34.907140+0000","last_became_active":"2024-05-04T07:50:27.510197+0000","last_became_peered":"2024-05-04T07:50:27.510197+0000","last_unstale":"2024-05-04T07:50:34.907140+0000","last_undegraded":"2024-05-04T07:50:34.907140+0000","last_fullsized":"2024-05-04T07:50:34.907140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707313+0000","last_change":"2024-05-04T07:50:27.520114+0000","last_active":"2024-05-04T07:50:34.707313+0000","last_peered":"2024-05-04T07:50:34.707313+0000","last_clean":"2024-05-04T07:50:34.707313+0000","last_became_active":"2024-05-04T07:50:27.518799+0000","last_became_peered":"2024-05-04T07:50:27.518799+0000","last_unstale":"2024-05-04T07:50:34.707313+0000","last_undegraded":"2024-05-04T07:50:34.707313+0000","last_fullsized":"2024-05-04T07:50:34.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677494+0000","last_change":"2024-05-04T07:50:27.521160+0000","last_active":"2024-05-04T07:50:34.677494+0000","last_peered":"2024-05-04T07:50:34.677494+0000","last_clean":"2024-05-04T07:50:34.677494+0000","last_became_active":"2024-05-04T07:50:27.520786+0000","last_became_peered":"2024-05-04T07:50:27.520786+0000","last_unstale":"2024-05-04T07:50:34.677494+0000","last_undegraded":"2024-05-04T07:50:34.677494+0000","last_fullsized":"2024-05-04T07:50:34.677494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:37.987648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:50:51.609 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T07:50:51.609 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-04T07:50:51.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-04T07:50:51.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-04T07:50:51.610 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-04T07:50:51.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.841+0000 7fe624000640 1 Processor -- start 2024-05-04T07:50:51.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.842+0000 7fe624000640 1 -- start start 2024-05-04T07:50:51.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.843+0000 7fe624000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe61c13ff40 0x7fe61c145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.843+0000 7fe624000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.843+0000 7fe624000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61c146900 con 0x7fe61c1463a0 2024-05-04T07:50:51.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.843+0000 7fe624000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe61c140320 con 0x7fe61c13ff40 2024-05-04T07:50:51.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.843+0000 7fe624000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c15de40 con 0x7fe61c072600 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe61c13ff40 0x7fe61c145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe61c13ff40 0x7fe61c145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38916/0 (socket says 172.21.15.136:38916) 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 -- 172.21.15.136:0/1110890947 learned_addr learned my addr 172.21.15.136:0/1110890947 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe620c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe61c1463a0 0x7fe61c071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41448/0 (socket says 172.21.15.136:41448) 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe622000640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 -- 172.21.15.136:0/1110890947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 msgr2=0x7fe61c0c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:51.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c0c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 -- 172.21.15.136:0/1110890947 >> v1:172.21.15.136:6789/0 conn(0x7fe61c1463a0 legacy=0x7fe61c071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.844+0000 7fe621600640 1 -- 172.21.15.136:0/1110890947 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c15d7f0 con 0x7fe61c13ff40 2024-05-04T07:50:51.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.845+0000 7fe621600640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c13ff40 0x7fe61c145e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61002a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1db93f5a63218ae server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.845+0000 7fe61be00640 1 -- 172.21.15.136:0/1110890947 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610037070 con 0x7fe61c13ff40 2024-05-04T07:50:51.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe61be00640 1 -- 172.21.15.136:0/1110890947 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe610032440 con 0x7fe61c13ff40 2024-05-04T07:50:51.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe61be00640 1 -- 172.21.15.136:0/1110890947 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe610032810 con 0x7fe61c13ff40 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 -- 172.21.15.136:0/1110890947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c13ff40 msgr2=0x7fe61c145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c13ff40 0x7fe61c145e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61002a240 comp rx=0 tx=0).stop 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 -- 172.21.15.136:0/1110890947 shutdown_connections 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c0c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 --2- 172.21.15.136:0/1110890947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c13ff40 0x7fe61c145e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 -- 172.21.15.136:0/1110890947 >> 172.21.15.136:0/1110890947 conn(0x7fe61c0d0c30 msgr2=0x7fe61c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 -- 172.21.15.136:0/1110890947 shutdown_connections 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.846+0000 7fe624000640 1 -- 172.21.15.136:0/1110890947 wait complete. 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.848+0000 7fe624000640 1 Processor -- start 2024-05-04T07:50:51.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.848+0000 7fe624000640 1 -- start start 2024-05-04T07:50:51.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c1f9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c13ff40 0x7fe61c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c15d4a0 con 0x7fe61c1463a0 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c161910 con 0x7fe61c13ff40 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe624000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c15e2d0 con 0x7fe61c072600 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe622000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe622000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38920/0 (socket says 172.21.15.136:38920) 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.849+0000 7fe622000640 1 -- 172.21.15.136:0/806224119 learned_addr learned my addr 172.21.15.136:0/806224119 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe621600640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c1f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe620c00640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c13ff40 0x7fe61c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 -- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 msgr2=0x7fe61c1f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c1f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 -- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c13ff40 msgr2=0x7fe61c0c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c13ff40 0x7fe61c0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 -- 172.21.15.136:0/806224119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c1fdd60 con 0x7fe61c1463a0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe621600640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c1f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe622000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe614007e60 tx=0x7fe61400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614014420 con 0x7fe61c1463a0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614019070 con 0x7fe61c1463a0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614014820 con 0x7fe61c1463a0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.850+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c1530f0 con 0x7fe61c1463a0 2024-05-04T07:50:51.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.851+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c1536b0 con 0x7fe61c1463a0 2024-05-04T07:50:51.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.852+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c069400 con 0x7fe61c1463a0 2024-05-04T07:50:51.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.853+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe6140149c0 con 0x7fe61c1463a0 2024-05-04T07:50:51.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.854+0000 7fe619600640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 0x7fe5fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:51.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.854+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe614098110 con 0x7fe61c1463a0 2024-05-04T07:50:51.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.854+0000 7fe621600640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 0x7fe5fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:51.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.855+0000 7fe621600640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 0x7fe5fc078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe610034000 tx=0x7fe61002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:51.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:51.858+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe614061170 con 0x7fe61c1463a0 2024-05-04T07:50:52.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.123+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe61c0c7970 con 0x7fe61c1463a0 2024-05-04T07:50:52.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.127+0000 7fe619600640 1 -- 172.21.15.136:0/806224119 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189528 (secure 0 0 0) 0x7fe614065470 con 0x7fe61c1463a0 2024-05-04T07:50:52.130 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 msgr2=0x7fe5fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 0x7fe5fc078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe610034000 tx=0x7fe61002e000 comp rx=0 tx=0).stop 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 msgr2=0x7fe61c0c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe614007e60 tx=0x7fe61400e4b0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 shutdown_connections 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe5fc0762d0 0x7fe5fc078790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61c1463a0 0x7fe61c0c6ce0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c13ff40 0x7fe61c0c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 --2- 172.21.15.136:0/806224119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c072600 0x7fe61c1f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 >> 172.21.15.136:0/806224119 conn(0x7fe61c0d0c30 msgr2=0x7fe61c145820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:52.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 shutdown_connections 2024-05-04T07:50:52.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.132+0000 7fe624000640 1 -- 172.21.15.136:0/806224119 wait complete. 2024-05-04T07:50:52.152 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2630771631},{"type":"v1","addr":"172.21.15.136:6833","nonce":2630771631}]},"active_addr":"172.21.15.136:6833/2630771631","active_change":"2024-05-04T07:50:07.253315+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1614887547}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1446017865}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2395373002}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":2750074587}]}]} 2024-05-04T07:50:52.157 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-04T07:50:52.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-04T07:50:52.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:52.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.352+0000 7fe0bb200640 1 Processor -- start 2024-05-04T07:50:52.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.352+0000 7fe0bb200640 1 -- start start 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.353+0000 7fe0bb200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0bc15f510 0x7fe0bc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.353+0000 7fe0bb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.353+0000 7fe0bb200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc0d1690 con 0x7fe0bc06dce0 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.353+0000 7fe0bb200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe0bc0d1970 con 0x7fe0bc15f510 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.353+0000 7fe0bb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe0bc0cbd80 con 0x7fe0bc0cc9c0 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0bc15f510 0x7fe0bc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0bc15f510 0x7fe0bc0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38924/0 (socket says 172.21.15.136:38924) 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 -- 172.21.15.136:0/1408829168 learned_addr learned my addr 172.21.15.136:0/1408829168 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0ba800640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 -- 172.21.15.136:0/1408829168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc0cc9c0 msgr2=0x7fe0bc0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 -- 172.21.15.136:0/1408829168 >> v1:172.21.15.142:6789/0 conn(0x7fe0bc06dce0 legacy=0x7fe0bc06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:52.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.354+0000 7fe0b3e00640 1 -- 172.21.15.136:0/1408829168 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc0cc060 con 0x7fe0bc15f510 2024-05-04T07:50:52.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.355+0000 7fe0b3e00640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0ccf10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673e74cbcdd39778 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.356+0000 7fe0b9400640 1 -- 172.21.15.136:0/1408829168 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4037070 con 0x7fe0bc15f510 2024-05-04T07:50:52.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.356+0000 7fe0b9400640 1 -- 172.21.15.136:0/1408829168 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a4032440 con 0x7fe0bc15f510 2024-05-04T07:50:52.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.356+0000 7fe0b9400640 1 -- 172.21.15.136:0/1408829168 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4032810 con 0x7fe0bc15f510 2024-05-04T07:50:52.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 -- 172.21.15.136:0/1408829168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 msgr2=0x7fe0bc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0ccf10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a402a250 comp rx=0 tx=0).stop 2024-05-04T07:50:52.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 -- 172.21.15.136:0/1408829168 shutdown_connections 2024-05-04T07:50:52.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1408829168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0ccf10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 -- 172.21.15.136:0/1408829168 >> 172.21.15.136:0/1408829168 conn(0x7fe0bc0d09d0 msgr2=0x7fe0bc0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:52.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 -- 172.21.15.136:0/1408829168 shutdown_connections 2024-05-04T07:50:52.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.357+0000 7fe0bb200640 1 -- 172.21.15.136:0/1408829168 wait complete. 2024-05-04T07:50:52.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.359+0000 7fe0bb200640 1 Processor -- start 2024-05-04T07:50:52.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.359+0000 7fe0bb200640 1 -- start start 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc06dce0 0x7fe0bc151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc0aef40 con 0x7fe0bc15f510 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc0aedc0 con 0x7fe0bc0cc9c0 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0bb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe0bc0af0c0 con 0x7fe0bc06dce0 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0ba800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0ba800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38938/0 (socket says 172.21.15.136:38938) 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0ba800640 1 -- 172.21.15.136:0/1918110828 learned_addr learned my addr 172.21.15.136:0/1918110828 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0b9e00640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc06dce0 0x7fe0bc151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.360+0000 7fe0b3e00640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 -- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc06dce0 msgr2=0x7fe0bc151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc06dce0 0x7fe0bc151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 -- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0bc0cc9c0 msgr2=0x7fe0bc0c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 -- 172.21.15.136:0/1918110828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc1f8570 con 0x7fe0bc15f510 2024-05-04T07:50:52.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0ba800640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007e70 tx=0x7fe0b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4014620 con 0x7fe0bc15f510 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b4019070 con 0x7fe0bc15f510 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4014a20 con 0x7fe0bc15f510 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc1f8850 con 0x7fe0bc15f510 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.361+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1f8e10 con 0x7fe0bc15f510 2024-05-04T07:50:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.363+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0bc069400 con 0x7fe0bc15f510 2024-05-04T07:50:52.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.364+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0b4014bc0 con 0x7fe0bc15f510 2024-05-04T07:50:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.365+0000 7fe0b2000640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 0x7fe098078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.365+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe0b40981b0 con 0x7fe0bc15f510 2024-05-04T07:50:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.365+0000 7fe0b9e00640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 0x7fe098078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.366+0000 7fe0b9e00640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 0x7fe098078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac004ea0 tx=0x7fe0ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.369+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe0b4061860 con 0x7fe0bc15f510 2024-05-04T07:50:52.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.581+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0bc15d1d0 con 0x7fe0bc15f510 2024-05-04T07:50:52.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.582+0000 7fe0b2000640 1 -- 172.21.15.136:0/1918110828 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7fe0b4061160 con 0x7fe0bc15f510 2024-05-04T07:50:52.583 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 msgr2=0x7fe098078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 0x7fe098078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac004ea0 tx=0x7fe0ac009040 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 msgr2=0x7fe0bc0b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007e70 tx=0x7fe0b400e4b0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 shutdown_connections 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe0980762d0 0x7fe098078790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0bc15f510 0x7fe0bc0b4bd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0bc0cc9c0 0x7fe0bc0c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 --2- 172.21.15.136:0/1918110828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0bc06dce0 0x7fe0bc151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 >> 172.21.15.136:0/1918110828 conn(0x7fe0bc0d09d0 msgr2=0x7fe0bc0cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 shutdown_connections 2024-05-04T07:50:52.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.586+0000 7fe0bb200640 1 -- 172.21.15.136:0/1918110828 wait complete. 2024-05-04T07:50:52.605 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-04T07:50:52.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:52.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.806+0000 7f0ef6e00640 1 Processor -- start 2024-05-04T07:50:52.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.806+0000 7f0ef6e00640 1 -- start start 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.807+0000 7f0ef6e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.807+0000 7f0ef6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.807+0000 7f0ef6e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef00cfe90 con 0x7f0ef00d5ce0 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.807+0000 7f0ef6e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef00cfc60 con 0x7f0ef015f3f0 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.807+0000 7f0ef6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef00d0170 con 0x7f0ef00d36c0 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.808+0000 7f0ef4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.808+0000 7f0eefe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.808+0000 7f0eefe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46378/0 (socket says 172.21.15.136:46378) 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.808+0000 7f0ef4e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34098/0 (socket says 172.21.15.136:34098) 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.808+0000 7f0eefe00640 1 -- 172.21.15.136:0/1139750051 learned_addr learned my addr 172.21.15.136:0/1139750051 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.809+0000 7f0ef4e00640 1 -- 172.21.15.136:0/1139750051 >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 msgr2=0x7f0ef00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.809+0000 7f0ef4e00640 1 --2- 172.21.15.136:0/1139750051 >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.809+0000 7f0ef4e00640 1 -- 172.21.15.136:0/1139750051 >> v1:172.21.15.142:6789/0 conn(0x7f0ef00d5ce0 legacy=0x7f0ef00d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.809+0000 7f0ef4e00640 1 -- 172.21.15.136:0/1139750051 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef00d0450 con 0x7f0ef00d36c0 2024-05-04T07:50:52.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.809+0000 7f0eefe00640 1 --2- 172.21.15.136:0/1139750051 >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:52.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.810+0000 7f0ef4e00640 1 --2- 172.21.15.136:0/1139750051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b88f6bc4bf261b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.810+0000 7f0eef400640 1 -- 172.21.15.136:0/1139750051 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007740 con 0x7f0ef00d36c0 2024-05-04T07:50:52.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0eef400640 1 -- 172.21.15.136:0/1139750051 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee80078e0 con 0x7f0ef00d36c0 2024-05-04T07:50:52.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0eef400640 1 -- 172.21.15.136:0/1139750051 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007cb0 con 0x7f0ef00d36c0 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 -- 172.21.15.136:0/1139750051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 msgr2=0x7f0ef00d3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/1139750051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802a6f0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 -- 172.21.15.136:0/1139750051 shutdown_connections 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/1139750051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d36c0 0x7f0ef00d3b50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/1139750051 >> v2:172.21.15.142:3300/0 conn(0x7f0ef015f3f0 0x7f0ef00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 -- 172.21.15.136:0/1139750051 >> 172.21.15.136:0/1139750051 conn(0x7f0ef00d50e0 msgr2=0x7f0ef00d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 -- 172.21.15.136:0/1139750051 shutdown_connections 2024-05-04T07:50:52.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.811+0000 7f0ef6e00640 1 -- 172.21.15.136:0/1139750051 wait complete. 2024-05-04T07:50:52.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.813+0000 7f0ef6e00640 1 Processor -- start 2024-05-04T07:50:52.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.813+0000 7f0ef6e00640 1 -- start start 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef00d36c0 0x7f0ef00baba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d5ce0 0x7f0ef00b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef015f7d0 con 0x7f0ef015f3f0 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef00d0a10 con 0x7f0ef00d36c0 2024-05-04T07:50:52.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.814+0000 7f0ef6e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef015f950 con 0x7f0ef00d5ce0 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38952/0 (socket says 172.21.15.136:38952) 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 -- 172.21.15.136:0/2520245415 learned_addr learned my addr 172.21.15.136:0/2520245415 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0eefe00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef00d36c0 0x7f0ef00baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ee7e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d5ce0 0x7f0ef00b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 -- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d5ce0 msgr2=0x7f0ef00b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d5ce0 0x7f0ef00b7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 -- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef00d36c0 msgr2=0x7f0ef00baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef00d36c0 0x7f0ef00baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.815+0000 7f0ef4e00640 1 -- 172.21.15.136:0/2520245415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef00cc1b0 con 0x7f0ef015f3f0 2024-05-04T07:50:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0ef4e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ee802ace0 tx=0x7f0ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8040070 con 0x7f0ef015f3f0 2024-05-04T07:50:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee8031bc0 con 0x7f0ef015f3f0 2024-05-04T07:50:52.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef00cc490 con 0x7f0ef015f3f0 2024-05-04T07:50:52.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8009450 con 0x7f0ef015f3f0 2024-05-04T07:50:52.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.816+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef00cca50 con 0x7f0ef015f3f0 2024-05-04T07:50:52.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.817+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef0069400 con 0x7f0ef015f3f0 2024-05-04T07:50:52.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.818+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ee8039040 con 0x7f0ef015f3f0 2024-05-04T07:50:52.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.819+0000 7f0eecc00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 0x7f0ecc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:52.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.819+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ee80b90e0 con 0x7f0ef015f3f0 2024-05-04T07:50:52.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.820+0000 7f0eefe00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 0x7f0ecc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:52.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.820+0000 7f0eefe00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 0x7f0ecc078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009ac0 tx=0x7f0ee0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:52.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:52.824+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ee8082700 con 0x7f0ef015f3f0 2024-05-04T07:50:53.031 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.031+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef00b7680 con 0x7f0ef015f3f0 2024-05-04T07:50:53.033 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.033+0000 7f0eecc00640 1 -- 172.21.15.136:0/2520245415 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f0ee8082000 con 0x7f0ef015f3f0 2024-05-04T07:50:53.034 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:53.034 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:53.036 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.035+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 msgr2=0x7f0ecc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.035+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 0x7f0ecc078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009ac0 tx=0x7f0ee0008040 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.035+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 msgr2=0x7f0ef014f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.035+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ee802ace0 tx=0x7f0ee8004a40 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 shutdown_connections 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0ecc0762d0 0x7f0ecc078790 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef015f3f0 0x7f0ef014f3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ef00d5ce0 0x7f0ef00b7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 --2- 172.21.15.136:0/2520245415 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ef00d36c0 0x7f0ef00baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 >> 172.21.15.136:0/2520245415 conn(0x7f0ef00d50e0 msgr2=0x7f0ef00d2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 shutdown_connections 2024-05-04T07:50:53.037 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.036+0000 7f0ef6e00640 1 -- 172.21.15.136:0/2520245415 wait complete. 2024-05-04T07:50:53.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-04T07:50:53.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-04T07:50:53.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-04T07:50:53.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-04T07:50:53.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-04T07:50:53.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-04T07:50:53.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-04T07:50:53.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-04T07:50:53.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.334+0000 7f9a90c00640 1 Processor -- start 2024-05-04T07:50:53.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.334+0000 7f9a90c00640 1 -- start start 2024-05-04T07:50:53.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.336+0000 7f9a90c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a8c0b7080 0x7f9a8c0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.336+0000 7f9a90c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.336+0000 7f9a90c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0b7600 con 0x7f9a8c0b6ca0 2024-05-04T07:50:53.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.336+0000 7f9a90c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8c0b78e0 con 0x7f9a8c0b7080 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.336+0000 7f9a90c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c0b53c0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.337+0000 7f9a8a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.337+0000 7f9a8a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34112/0 (socket says 172.21.15.136:34112) 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.337+0000 7f9a8a800640 1 -- 172.21.15.136:0/386279164 learned_addr learned my addr 172.21.15.136:0/386279164 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.337+0000 7f9a89400640 1 --2- 172.21.15.136:0/386279164 >> v2:172.21.15.142:3300/0 conn(0x7f9a8c0b7080 0x7f9a8c0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.338+0000 7f9a8a800640 1 -- 172.21.15.136:0/386279164 >> v2:172.21.15.142:3300/0 conn(0x7f9a8c0b7080 msgr2=0x7f9a8c0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.338+0000 7f9a8a800640 1 --2- 172.21.15.136:0/386279164 >> v2:172.21.15.142:3300/0 conn(0x7f9a8c0b7080 0x7f9a8c0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.338+0000 7f9a8a800640 1 -- 172.21.15.136:0/386279164 >> v1:172.21.15.142:6789/0 conn(0x7f9a8c0b6ca0 legacy=0x7f9a8c0d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.338+0000 7f9a8a800640 1 -- 172.21.15.136:0/386279164 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c0b56a0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.340+0000 7f9a8a800640 1 --2- 172.21.15.136:0/386279164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009870 tx=0x7f9a7c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=915e7f40e0716c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.342+0000 7f9a88a00640 1 -- 172.21.15.136:0/386279164 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c037070 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.342+0000 7f9a88a00640 1 -- 172.21.15.136:0/386279164 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7c032440 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.342+0000 7f9a88a00640 1 -- 172.21.15.136:0/386279164 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c032850 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 -- 172.21.15.136:0/386279164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 msgr2=0x7f9a8c0d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 --2- 172.21.15.136:0/386279164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009870 tx=0x7f9a7c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 -- 172.21.15.136:0/386279164 shutdown_connections 2024-05-04T07:50:53.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 --2- 172.21.15.136:0/386279164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b63f0 0x7f9a8c0d35c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 --2- 172.21.15.136:0/386279164 >> v2:172.21.15.142:3300/0 conn(0x7f9a8c0b7080 0x7f9a8c0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.345+0000 7f9a90c00640 1 -- 172.21.15.136:0/386279164 >> 172.21.15.136:0/386279164 conn(0x7f9a8c0d4fb0 msgr2=0x7f9a8c0d53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.346+0000 7f9a90c00640 1 -- 172.21.15.136:0/386279164 shutdown_connections 2024-05-04T07:50:53.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.346+0000 7f9a90c00640 1 -- 172.21.15.136:0/386279164 wait complete. 2024-05-04T07:50:53.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.347+0000 7f0465800640 1 Processor -- start 2024-05-04T07:50:53.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.347+0000 7f0465800640 1 -- start start 2024-05-04T07:50:53.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.349+0000 7f9a90c00640 1 Processor -- start 2024-05-04T07:50:53.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.349+0000 7f9a90c00640 1 -- start start 2024-05-04T07:50:53.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.349+0000 7f0465800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f045803c0a0 0x7f04580e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.349+0000 7f0465800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0458053cb0 0x7f0458054120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f0465800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0458054660 con 0x7f04580e3160 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f0465800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0458007b70 con 0x7f0458053cb0 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f0465800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0458058810 con 0x7f045803c0a0 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f045e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f045803c0a0 0x7f04580e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f045e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f045803c0a0 0x7f04580e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34122/0 (socket says 172.21.15.136:34122) 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f045e000640 1 -- 172.21.15.136:0/90156578 learned_addr learned my addr 172.21.15.136:0/90156578 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f9a90c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 0x7f9a8c09fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.350+0000 7f9a90c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8c0b6ca0 0x7f9a8c0a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.351+0000 7f9a89e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 0x7f9a8c09fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.351+0000 7f9a89e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 0x7f9a8c09fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38956/0 (socket says 172.21.15.136:38956) 2024-05-04T07:50:53.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f9a89e00640 1 -- 172.21.15.136:0/3469034044 learned_addr learned my addr 172.21.15.136:0/3469034044 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.351+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151948784 0 0) 0x7f0458054660 con 0x7f04580e3160 2024-05-04T07:50:53.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.351+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0444003520 con 0x7f04580e3160 2024-05-04T07:50:53.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f9a90c00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b7080 0x7f9a8c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7fd931000640 1 Processor -- start 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f9a89400640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8c0b6ca0 0x7f9a8c0a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1850716287 0 0) 0x7f0444003520 con 0x7f04580e3160 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f045803c0a0 msgr2=0x7f04580e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f045803c0a0 0x7f04580e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 >> v2:172.21.15.136:3300/0 conn(0x7f0458053cb0 msgr2=0x7f0458054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 --2- 172.21.15.136:0/90156578 >> v2:172.21.15.136:3300/0 conn(0x7f0458053cb0 0x7f0458054120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458058af0 con 0x7f04580e3160 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f0460064010 con 0x7f04580e3160 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 >> v1:172.21.15.136:6789/0 conn(0x7f04580e3160 legacy=0x7f0458058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0444004350 0x7f0444004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f044400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0458058810 con 0x7f0444004350 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f044400bf00 con 0x7f04440039b0 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f044400c080 con 0x7f0444004fc0 2024-05-04T07:50:53.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7fd931000640 1 -- start start 2024-05-04T07:50:53.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.352+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c0d3c80 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c0d3b00 con 0x7f9a8c0b6ca0 2024-05-04T07:50:53.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f6ffb200640 1 Processor -- start 2024-05-04T07:50:53.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c0cfca0 con 0x7f9a8c0b7080 2024-05-04T07:50:53.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f9a8a800640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b7080 0x7f9a8c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f045e000640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0444004350 0x7f0444004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f045f400640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f044400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fccbe200640 1 Processor -- start 2024-05-04T07:50:53.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89e00640 1 -- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b7080 msgr2=0x7f9a8c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fccbe200640 1 -- start start 2024-05-04T07:50:53.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fd931000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd92c0cb7b0 0x7fd92c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fd931000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd92c0ced70 con 0x7fd92c0ce820 2024-05-04T07:50:53.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fd931000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd92c0cf050 con 0x7fd92c071ed0 2024-05-04T07:50:53.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7fd931000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd92c0c45c0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89e00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b7080 0x7f9a8c0ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89e00640 1 -- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8c0b6ca0 msgr2=0x7f9a8c0a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89e00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8c0b6ca0 0x7f9a8c0a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89e00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c0a2cd0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a8a800640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a8c0b7080 0x7f9a8c0ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.354+0000 7f9a89400640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8c0b6ca0 0x7f9a8c0a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.353+0000 7f6ffb200640 1 -- start start 2024-05-04T07:50:53.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f6ffb200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 0x7f6ff0057690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7fd929e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd92c071ed0 0x7fd92c0722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:42808/0 (socket says 172.21.15.136:42808) 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7fd929e00640 1 -- 172.21.15.136:0/1494106794 learned_addr learned my addr 172.21.15.136:0/1494106794 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f6ffb200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ff00e48e0 0x7f6ff0054940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f6ffb200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff0054e80 con 0x7f6ff003bd50 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f6ffb200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff0038020 con 0x7f6ff00e4500 2024-05-04T07:50:53.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f6ffb200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff0038300 con 0x7f6ff00e48e0 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fd92a800640 1 --2- 172.21.15.136:0/1494106794 >> v2:172.21.15.136:3300/0 conn(0x7fd92c0cb7b0 0x7fd92c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7f6ff9e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 0x7f6ff0057690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7f6ffa800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6ff003bd50 0x7f6ff003c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41480/0 (socket says 172.21.15.136:41480) 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7f6ffa800640 1 -- 172.21.15.136:0/3502165900 learned_addr learned my addr 172.21.15.136:0/3502165900 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fccbe200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccb80cc080 0x7fccb80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fccbe200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 0x7fccb80728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7f6ff9400640 1 --2- 172.21.15.136:0/3502165900 >> v2:172.21.15.142:3300/0 conn(0x7f6ff00e48e0 0x7f6ff0054940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fccbe200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb80ceac0 con 0x7fccb80d1740 2024-05-04T07:50:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fccbe200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80cd420 con 0x7fccb80cfb60 2024-05-04T07:50:53.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.356+0000 7fccbe200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fccb80ceda0 con 0x7fccb80cc080 2024-05-04T07:50:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f045f400640 1 -- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04440039b0 msgr2=0x7f0444003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-04T07:50:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714520118 0 0) 0x7fd92c0cf050 con 0x7fd92c071ed0 2024-05-04T07:50:53.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd910003520 con 0x7fd92c071ed0 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f045f400640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f045f400640 1 -- 172.21.15.136:0/90156578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0444004350 msgr2=0x7f0444004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fccb7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 0x7fccb80728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fccb6a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccb80cc080 0x7fccb80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fccb7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 0x7fccb80728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38992/0 (socket says 172.21.15.136:38992) 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fccb7400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fccb80d1740 0x7fccb815b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41496/0 (socket says 172.21.15.136:41496) 2024-05-04T07:50:53.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fccb7e00640 1 -- 172.21.15.136:0/2893972353 learned_addr learned my addr 172.21.15.136:0/2893972353 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f045f400640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0444004350 0x7f0444004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.355+0000 7f045f400640 1 -- 172.21.15.136:0/90156578 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458058af0 con 0x7f0444004fc0 2024-05-04T07:50:53.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7f045f400640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f044400b9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f044c009890 tx=0x7f0444005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd10767a138d7d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd92a800640 1 -- 172.21.15.136:0/1494106794 >> v1:172.21.15.142:6789/0 conn(0x7fd92c071ed0 legacy=0x7fd92c0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd92a800640 1 -- 172.21.15.136:0/1494106794 >> v1:172.21.15.136:6789/0 conn(0x7fd92c0ce820 legacy=0x7fd92c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd92a800640 1 -- 172.21.15.136:0/1494106794 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c0cf330 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778999826 0 0) 0x7fd92c0ced70 con 0x7fd92c0ce820 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c037070 con 0x7f0444004fc0 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c02aaa0 con 0x7f0444004fc0 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7f045d600640 1 -- 172.21.15.136:0/90156578 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c009460 con 0x7f0444004fc0 2024-05-04T07:50:53.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7f9a89e00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 0x7f9a8c09fe70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c7c0 tx=0x7f9a8400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7fccb6a00640 1 -- 172.21.15.136:0/2893972353 >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 msgr2=0x7fccb80728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84016020 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8400aa50 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84012420 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c0a29f0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c0b9200 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f0465800640 1 -- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 msgr2=0x7f044400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f0465800640 1 --2- 172.21.15.136:0/90156578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f044400b9c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f044c009890 tx=0x7f0444005830 comp rx=0 tx=0).stop 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f045f400640 1 -- 172.21.15.136:0/90156578 reap_dead start 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7f0465800640 1 -- 172.21.15.136:0/90156578 shutdown_connections 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7f0465800640 1 -- 172.21.15.136:0/90156578 >> 172.21.15.136:0/90156578 conn(0x7f0458058ee0 msgr2=0x7f04580592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7fd92a800640 1 --2- 172.21.15.136:0/1494106794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0cb7b0 0x7fd92c0cfe10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd924009dc0 tx=0x7fd92402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798ef9c44d25853c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924007740 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7fccb6a00640 1 --2- 172.21.15.136:0/2893972353 >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 0x7fccb80728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7fccb6a00640 1 -- 172.21.15.136:0/2893972353 >> v1:172.21.15.136:6789/0 conn(0x7fccb80d1740 legacy=0x7fccb815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.358+0000 7fccb6a00640 1 -- 172.21.15.136:0/2893972353 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80cf080 con 0x7fccb80cc080 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f6ff9400640 1 -- 172.21.15.136:0/3502165900 >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 msgr2=0x7f6ff0057690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f6ff9400640 1 --2- 172.21.15.136:0/3502165900 >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 0x7f6ff0057690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f6ff9400640 1 -- 172.21.15.136:0/3502165900 >> v1:172.21.15.136:6789/0 conn(0x7f6ff003bd50 legacy=0x7f6ff003c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.357+0000 7f6ff8a00640 1 -- 172.21.15.136:0/3502165900 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310560332 0 0) 0x7f6ff0054e80 con 0x7f6ff003bd50 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.359+0000 7f6ff9400640 1 -- 172.21.15.136:0/3502165900 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00072e0 con 0x7f6ff00e48e0 2024-05-04T07:50:53.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7f6ff9e00640 1 --2- 172.21.15.136:0/3502165900 >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 0x7f6ff0057690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9240078e0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7fd928a00640 1 -- 172.21.15.136:0/1494106794 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924007740 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a8c0b95d0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7f0465800640 1 -- 172.21.15.136:0/90156578 shutdown_connections 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.360+0000 7fccb6a00640 1 --2- 172.21.15.136:0/2893972353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80ccee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccb8070870 tx=0x7fcca802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96198d76f6c92ee8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7fccb6000640 1 -- 172.21.15.136:0/2893972353 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8037070 con 0x7fccb80cc080 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7fccb6000640 1 -- 172.21.15.136:0/2893972353 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca8032440 con 0x7fccb80cc080 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7f6ff9400640 1 --2- 172.21.15.136:0/3502165900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff00e48e0 0x7f6ff0054940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0035ce0 tx=0x7f6fe402e430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7edd4397e5c22b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7fd931000640 1 -- 172.21.15.136:0/1494106794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0cb7b0 msgr2=0x7fd92c0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7fccb6000640 1 -- 172.21.15.136:0/2893972353 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8032850 con 0x7fccb80cc080 2024-05-04T07:50:53.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7f6ff8a00640 1 -- 172.21.15.136:0/3502165900 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe403a070 con 0x7f6ff00e48e0 2024-05-04T07:50:53.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7fd931000640 1 --2- 172.21.15.136:0/1494106794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0cb7b0 0x7fd92c0cfe10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd924009dc0 tx=0x7fd92402a730 comp rx=0 tx=0).stop 2024-05-04T07:50:53.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.361+0000 7f0465800640 1 -- 172.21.15.136:0/90156578 wait complete. 2024-05-04T07:50:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.362+0000 7f6ff8a00640 1 -- 172.21.15.136:0/3502165900 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4033710 con 0x7f6ff00e48e0 2024-05-04T07:50:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.362+0000 7f6ff8a00640 1 -- 172.21.15.136:0/3502165900 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4033ae0 con 0x7f6ff00e48e0 2024-05-04T07:50:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.362+0000 7fd931000640 1 -- 172.21.15.136:0/1494106794 shutdown_connections 2024-05-04T07:50:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.362+0000 7fd931000640 1 --2- 172.21.15.136:0/1494106794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0cb7b0 0x7fd92c0cfe10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.362+0000 7fd931000640 1 -- 172.21.15.136:0/1494106794 >> 172.21.15.136:0/1494106794 conn(0x7fd92c0d0c50 msgr2=0x7fd92c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7fccbe200640 1 -- 172.21.15.136:0/2893972353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 msgr2=0x7fccb80ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7fccbe200640 1 --2- 172.21.15.136:0/2893972353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80ccee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccb8070870 tx=0x7fcca802a1c0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7fd931000640 1 -- 172.21.15.136:0/1494106794 shutdown_connections 2024-05-04T07:50:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7fd931000640 1 -- 172.21.15.136:0/1494106794 wait complete. 2024-05-04T07:50:53.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7f6ffb200640 1 -- 172.21.15.136:0/3502165900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff00e48e0 msgr2=0x7f6ff0054940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.363+0000 7f6ffb200640 1 --2- 172.21.15.136:0/3502165900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff00e48e0 0x7f6ff0054940 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0035ce0 tx=0x7f6fe402e430 comp rx=0 tx=0).stop 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fccbe200640 1 -- 172.21.15.136:0/2893972353 shutdown_connections 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fccbe200640 1 --2- 172.21.15.136:0/2893972353 >> v2:172.21.15.136:3300/0 conn(0x7fccb80cfb60 0x7fccb80728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fccbe200640 1 --2- 172.21.15.136:0/2893972353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80ccee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f6ffb200640 1 -- 172.21.15.136:0/3502165900 shutdown_connections 2024-05-04T07:50:53.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f6ffb200640 1 --2- 172.21.15.136:0/3502165900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff00e48e0 0x7f6ff0054940 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f6ffb200640 1 --2- 172.21.15.136:0/3502165900 >> v2:172.21.15.136:3300/0 conn(0x7f6ff00e4500 0x7f6ff0057690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f6ffb200640 1 -- 172.21.15.136:0/3502165900 >> 172.21.15.136:0/3502165900 conn(0x7f6ff0020040 msgr2=0x7f6ff0056d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f0465800640 1 Processor -- start 2024-05-04T07:50:53.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fccbe200640 1 -- 172.21.15.136:0/2893972353 >> 172.21.15.136:0/2893972353 conn(0x7fccb80d0c50 msgr2=0x7fccb80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fccbe200640 1 -- 172.21.15.136:0/2893972353 shutdown_connections 2024-05-04T07:50:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f0465800640 1 -- start start 2024-05-04T07:50:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7f9ee7800640 1 Processor -- start 2024-05-04T07:50:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.364+0000 7fb838600640 1 Processor -- start 2024-05-04T07:50:53.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7f9ee7800640 1 -- start start 2024-05-04T07:50:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7fb838600640 1 -- start start 2024-05-04T07:50:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7f0465800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f04580d7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7fd931000640 1 Processor -- start 2024-05-04T07:50:53.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7f0465800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0458052650 0x7f04580e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f6ffb200640 1 -- 172.21.15.136:0/3502165900 shutdown_connections 2024-05-04T07:50:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7f0465800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 0x7f045804e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f0465800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04580e3540 con 0x7f0458051c80 2024-05-04T07:50:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f0465800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0458006640 con 0x7f0458052650 2024-05-04T07:50:53.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f0465800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f04580e7780 con 0x7f0444004fc0 2024-05-04T07:50:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a84019020 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f045f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 0x7f045804e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f6ffb200640 1 -- 172.21.15.136:0/3502165900 wait complete. 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f8a70000640 1 Processor -- start 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f045e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0458052650 0x7f04580e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f045ea00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f04580d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f045f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 0x7f045804e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:38994/0 (socket says 172.21.15.136:38994) 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f045f400640 1 -- 172.21.15.136:0/3460967163 learned_addr learned my addr 172.21.15.136:0/3460967163 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.365+0000 7fccbe200640 1 -- 172.21.15.136:0/2893972353 wait complete. 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7f8a70000640 1 -- start start 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.366+0000 7fd931000640 1 -- start start 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f9ee7800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ee00d1a50 0x7f9ee015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fb838600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8300d1740 0x7fb8300ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fb838600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 0x7fb8300cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fb838600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8300ce820 con 0x7fb83015b320 2024-05-04T07:50:53.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fd931000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd92c071ed0 0x7fd92c1636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fb838600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb8300cd420 con 0x7fb8300d1740 2024-05-04T07:50:53.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7fb838600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300ceac0 con 0x7fb8300cc080 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045f400640 1 -- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 msgr2=0x7f04580d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045f400640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f04580d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045f400640 1 -- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0458052650 msgr2=0x7f04580e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045f400640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0458052650 0x7f04580e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045f400640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0458050150 con 0x7f0458051c80 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f045e000640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0458052650 0x7f04580e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f045ea00640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0444004fc0 0x7f04580d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.367+0000 7f9ee4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ee00d1a50 0x7f9ee015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee7800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee00d3c80 con 0x7f9ee00c9cc0 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee7800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee00d07d0 con 0x7f9ee00b6140 2024-05-04T07:50:53.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee7800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee00d0ab0 con 0x7f9ee00d1a50 2024-05-04T07:50:53.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fb835200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 0x7fb8300cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee4e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9ee00d1a50 0x7f9ee015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46458/0 (socket says 172.21.15.136:46458) 2024-05-04T07:50:53.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee5800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9ee00c9cc0 0x7f9ee00d3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41506/0 (socket says 172.21.15.136:41506) 2024-05-04T07:50:53.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9ee4e00640 1 -- 172.21.15.136:0/256647501 learned_addr learned my addr 172.21.15.136:0/256647501 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fd931000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 0x7fd92c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fb836600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb83015b320 0x7fb8300728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:42820/0 (socket says 172.21.15.136:42820) 2024-05-04T07:50:53.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fb836600640 1 -- 172.21.15.136:0/4248667788 learned_addr learned my addr 172.21.15.136:0/4248667788 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fd931000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0ce820 0x7fd92c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fb835c00640 1 --2- 172.21.15.136:0/4248667788 >> v2:172.21.15.142:3300/0 conn(0x7fb8300d1740 0x7fb8300ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fccbe200640 1 Processor -- start 2024-05-04T07:50:53.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fd929e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd92c071ed0 0x7fd92c1636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7fd929e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd92c071ed0 0x7fd92c1636f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46474/0 (socket says 172.21.15.136:46474) 2024-05-04T07:50:53.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9a82000640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a680763a0 0x7f9a68078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a84097cd0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.368+0000 7f9a82000640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f9a6807fb20 0x7f9a68081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a84025e50 con 0x7f9a6807fb20 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9a840980c0 con 0x7f9a8c0b63f0 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a70000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a68071ed0 0x7f8a680cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a70000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a680cb7b0 0x7f8a6806dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a70000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a680ced70 con 0x7f8a680ce820 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a70000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8a680c45c0 con 0x7f8a68071ed0 2024-05-04T07:50:53.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a70000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a680cf050 con 0x7f8a680cb7b0 2024-05-04T07:50:53.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9a89400640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a680763a0 0x7f9a68078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f045f400640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 0x7f045804e080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f044c000c00 tx=0x7f044c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9ee4e00640 1 -- 172.21.15.136:0/256647501 >> v1:172.21.15.142:6789/0 conn(0x7f9ee00b6140 legacy=0x7f9ee00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9ee4e00640 1 -- 172.21.15.136:0/256647501 >> v1:172.21.15.136:6789/0 conn(0x7f9ee00c9cc0 legacy=0x7f9ee00d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.391 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9ee4e00640 1 -- 172.21.15.136:0/256647501 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee00d0d90 con 0x7f9ee00d1a50 2024-05-04T07:50:53.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7fd929400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 0x7fd92c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f9a8a800640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f9a6807fb20 0x7f9a68081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.392 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7fccbe200640 1 -- start start 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7fb82fe00640 1 -- 172.21.15.136:0/4248667788 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137915531 0 0) 0x7fb8300ce820 con 0x7fb83015b320 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7fb82fe00640 1 -- 172.21.15.136:0/4248667788 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb818003520 con 0x7fb83015b320 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fd929400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 0x7fd92c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34176/0 (socket says 172.21.15.136:34176) 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.369+0000 7f8a6e000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a680cb7b0 0x7f8a6806dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7f8a6cc00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8a680ce820 0x7f8a680722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41516/0 (socket says 172.21.15.136:41516) 2024-05-04T07:50:53.393 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7f8a6cc00640 1 -- 172.21.15.136:0/3283834552 learned_addr learned my addr 172.21.15.136:0/3283834552 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fd92a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0ce820 0x7fd92c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7f8a6d600640 1 --2- 172.21.15.136:0/3283834552 >> v2:172.21.15.136:3300/0 conn(0x7f8a68071ed0 0x7f8a680cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c037050 con 0x7f0458051c80 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fd92a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0ce820 0x7fd92c0b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39010/0 (socket says 172.21.15.136:39010) 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fb835200640 1 -- 172.21.15.136:0/4248667788 >> v2:172.21.15.142:3300/0 conn(0x7fb8300d1740 msgr2=0x7fb8300ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fb835200640 1 --2- 172.21.15.136:0/4248667788 >> v2:172.21.15.142:3300/0 conn(0x7fb8300d1740 0x7fb8300ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fb835200640 1 -- 172.21.15.136:0/4248667788 >> v1:172.21.15.142:6789/0 conn(0x7fb83015b320 legacy=0x7fb8300728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7fb835200640 1 -- 172.21.15.136:0/4248667788 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300ceda0 con 0x7fb8300cc080 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c043070 con 0x7f0458051c80 2024-05-04T07:50:53.395 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c003a10 con 0x7f0458051c80 2024-05-04T07:50:53.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.370+0000 7f9ee4e00640 1 --2- 172.21.15.136:0/256647501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00d1a50 0x7f9ee015f190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351a2c29be2afbe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f8a6d600640 1 -- 172.21.15.136:0/3283834552 >> v2:172.21.15.142:3300/0 conn(0x7f8a680cb7b0 msgr2=0x7f8a6806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f8a6d600640 1 --2- 172.21.15.136:0/3283834552 >> v2:172.21.15.142:3300/0 conn(0x7f8a680cb7b0 0x7f8a6806dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f8a6d600640 1 -- 172.21.15.136:0/3283834552 >> v1:172.21.15.136:6789/0 conn(0x7f8a680ce820 legacy=0x7f8a680722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.396 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f8a6d600640 1 -- 172.21.15.136:0/3283834552 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a680cf330 con 0x7f8a68071ed0 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f6ffb200640 1 Processor -- start 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fd931000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c166e00 con 0x7fd92c0ce820 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fd931000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c0cf8f0 con 0x7fd92c071ed0 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fd931000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd92c0d08c0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fd929e00640 1 -- 172.21.15.136:0/803796321 learned_addr learned my addr 172.21.15.136:0/803796321 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fccbe200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7fccbe200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80cfb60 0x7fccb8146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f6ffb200640 1 -- start start 2024-05-04T07:50:53.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f9edf400640 1 -- 172.21.15.136:0/256647501 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc037070 con 0x7f9ee00d1a50 2024-05-04T07:50:53.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccbe200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fccb80d1740 0x7fccb81474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7f9edf400640 1 -- 172.21.15.136:0/256647501 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc032440 con 0x7f9ee00d1a50 2024-05-04T07:50:53.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0458050430 con 0x7f0458051c80 2024-05-04T07:50:53.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccbe200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80cfff0 con 0x7fccb80d1740 2024-05-04T07:50:53.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccbe200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80cf640 con 0x7fccb80cc080 2024-05-04T07:50:53.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccbe200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80c4120 con 0x7fccb80cfb60 2024-05-04T07:50:53.399 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fb835200640 1 --2- 172.21.15.136:0/4248667788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 0x7fb8300cfb60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097a0 tx=0x7fb81c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9c0045853d083 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f9a8a800640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f9a6807fb20 0x7f9a68081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7f9a89400640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a680763a0 0x7f9a68078860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0b3990 tx=0x7f9a74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.371+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045804ca10 con 0x7f0458051c80 2024-05-04T07:50:53.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccb7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccb6a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80cfb60 0x7fccb8146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccb7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46482/0 (socket says 172.21.15.136:46482) 2024-05-04T07:50:53.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccb7400640 1 -- 172.21.15.136:0/310997662 learned_addr learned my addr 172.21.15.136:0/310997662 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7f9edf400640 1 -- 172.21.15.136:0/256647501 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc032810 con 0x7f9ee00d1a50 2024-05-04T07:50:53.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7fccb7e00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fccb80d1740 0x7fccb81474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.372+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04580d7ac0 con 0x7f0458051c80 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f8a6d600640 1 --2- 172.21.15.136:0/3283834552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a68071ed0 0x7f8a680cfe10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097a0 tx=0x7f8a5402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473d8d599720f80b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff003bd50 0x7f6ff0180ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 0x7f6ff0056dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ff00e48e0 0x7f6ff017dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0005e90 con 0x7f6ff00e4500 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff003c8b0 con 0x7f6ff003bd50 2024-05-04T07:50:53.402 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f6ffb200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff0006010 con 0x7f6ff00e48e0 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f9ee7800640 1 -- 172.21.15.136:0/256647501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00d1a50 msgr2=0x7f9ee015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7f9ee7800640 1 --2- 172.21.15.136:0/256647501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00d1a50 0x7f9ee015f190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009870 tx=0x7f9ecc02a250 comp rx=0 tx=0).stop 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7fd929400640 1 -- 172.21.15.136:0/803796321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd92c071ed0 msgr2=0x7fd92c1636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7fd929400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd92c071ed0 0x7fd92c1636f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7fd929400640 1 -- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0ce820 msgr2=0x7fd92c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7fd929400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd92c0ce820 0x7fd92c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.373+0000 7fd929400640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c163c30 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 0x7f6ff0056dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 0x7f6ff0056dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39030/0 (socket says 172.21.15.136:39030) 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ff9400640 1 -- 172.21.15.136:0/1490150276 learned_addr learned my addr 172.21.15.136:0/1490150276 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fb82fe00640 1 -- 172.21.15.136:0/4248667788 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c037070 con 0x7fb8300cc080 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7400640 1 -- 172.21.15.136:0/310997662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80cfb60 msgr2=0x7fccb8146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7400640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80cfb60 0x7fccb8146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7400640 1 -- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fccb80d1740 msgr2=0x7fccb81474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f8a67e00640 1 -- 172.21.15.136:0/3283834552 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a68071ed0 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f8a67e00640 1 -- 172.21.15.136:0/3283834552 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a54032440 con 0x7f8a68071ed0 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f8a67e00640 1 -- 172.21.15.136:0/3283834552 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54032810 con 0x7f8a68071ed0 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fb82fe00640 1 -- 172.21.15.136:0/4248667788 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c02ae40 con 0x7fb8300cc080 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fb82fe00640 1 -- 172.21.15.136:0/4248667788 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c032660 con 0x7fb8300cc080 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f9ee7800640 1 -- 172.21.15.136:0/256647501 shutdown_connections 2024-05-04T07:50:53.405 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f9ee7800640 1 --2- 172.21.15.136:0/256647501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00d1a50 0x7f9ee015f190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f9ee7800640 1 -- 172.21.15.136:0/256647501 >> 172.21.15.136:0/256647501 conn(0x7f9ee00d5080 msgr2=0x7f9ee00d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7400640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fccb80d1740 0x7fccb81474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7400640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80c7e50 con 0x7fccb80cc080 2024-05-04T07:50:53.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fd929400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 0x7fd92c0c9a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c390 tx=0x7fd91800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.406 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7fccb7e00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fccb80d1740 0x7fccb81474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ffa800640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ff00e48e0 0x7f6ff017dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ff9e00640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff003bd50 0x7f6ff0180ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== osd.0 v2:172.21.15.136:6801/3794668031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a84025e50 con 0x7f9a6807fb20 2024-05-04T07:50:53.407 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f6ff9400640 1 -- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ff00e48e0 msgr2=0x7f6ff017dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.374+0000 7f9ee7800640 1 -- 172.21.15.136:0/256647501 shutdown_connections 2024-05-04T07:50:53.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918017070 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9180035f0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9180039e0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.408 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ff9400640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ff00e48e0 0x7f6ff017dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ff9400640 1 -- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff003bd50 msgr2=0x7f6ff0180ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ff9400640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff003bd50 0x7f6ff0180ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ff9400640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff01811e0 con 0x7f6ff00e4500 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ff9e00640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ff003bd50 0x7f6ff0180ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f9ee7800640 1 -- 172.21.15.136:0/256647501 wait complete. 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 -- 172.21.15.136:0/4248667788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 msgr2=0x7fb8300cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 --2- 172.21.15.136:0/4248667788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 0x7fb8300cfb60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097a0 tx=0x7fb81c02a0f0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fccb7400640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80c9b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c7a0 tx=0x7fccb000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 -- 172.21.15.136:0/4248667788 shutdown_connections 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 --2- 172.21.15.136:0/4248667788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8300cc080 0x7fb8300cfb60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 --2- 172.21.15.136:0/4248667788 >> v2:172.21.15.142:3300/0 conn(0x7fb8300d1740 0x7fb8300ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fb838600640 1 -- 172.21.15.136:0/4248667788 >> 172.21.15.136:0/4248667788 conn(0x7fb8300d0c50 msgr2=0x7fb8300d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f8a70000640 1 -- 172.21.15.136:0/3283834552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a68071ed0 msgr2=0x7f8a680cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f8a70000640 1 --2- 172.21.15.136:0/3283834552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a68071ed0 0x7f8a680cfe10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097a0 tx=0x7f8a5402a1d0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7fd931000640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c0ca3e0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7fd931000640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c0ca9a0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7fb838600640 1 -- 172.21.15.136:0/4248667788 shutdown_connections 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.375+0000 7f6ffa800640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6ff00e48e0 0x7f6ff017dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017070 con 0x7fccb80cc080 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f6ff9400640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 0x7f6ff0056dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4038040 tx=0x7f6fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f8a70000640 1 -- 172.21.15.136:0/3283834552 shutdown_connections 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f8a70000640 1 --2- 172.21.15.136:0/3283834552 >> v2:172.21.15.142:3300/0 conn(0x7f8a680cb7b0 0x7f8a6806dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.412 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f8a70000640 1 --2- 172.21.15.136:0/3283834552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a68071ed0 0x7f8a680cfe10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f8a70000640 1 -- 172.21.15.136:0/3283834552 >> 172.21.15.136:0/3283834552 conn(0x7f8a680d0c50 msgr2=0x7f8a680d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb000a640 con 0x7fccb80cc080 2024-05-04T07:50:53.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000a9f0 con 0x7fccb80cc080 2024-05-04T07:50:53.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.376+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4043070 con 0x7f6ff00e4500 2024-05-04T07:50:53.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff01814c0 con 0x7f6ff00e4500 2024-05-04T07:50:53.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff017d700 con 0x7f6ff00e4500 2024-05-04T07:50:53.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7fd931000640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd92c0c7d80 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe4033510 con 0x7f6ff00e4500 2024-05-04T07:50:53.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe403a030 con 0x7f6ff00e4500 2024-05-04T07:50:53.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb80c8de0 con 0x7fccb80cc080 2024-05-04T07:50:53.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb80b2440 con 0x7fccb80cc080 2024-05-04T07:50:53.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.378+0000 7f9ee7800640 1 Processor -- start 2024-05-04T07:50:53.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.378+0000 7f9ee7800640 1 -- start start 2024-05-04T07:50:53.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.378+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ff0005390 con 0x7f6ff00e4500 2024-05-04T07:50:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.378+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f044c003bb0 con 0x7f0458051c80 2024-05-04T07:50:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f8a70000640 1 -- 172.21.15.136:0/3283834552 shutdown_connections 2024-05-04T07:50:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccb8069470 con 0x7fccb80cc080 2024-05-04T07:50:53.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f8a70000640 1 -- 172.21.15.136:0/3283834552 wait complete. 2024-05-04T07:50:53.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00b6140 0x7f9ee0072fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.377+0000 7fb838600640 1 -- 172.21.15.136:0/4248667788 wait complete. 2024-05-04T07:50:53.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7fb838600640 1 Processor -- start 2024-05-04T07:50:53.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 0x7f9ee00cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ee00d1a50 0x7f9ee00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee00b6690 con 0x7f9ee00c9cc0 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee00d5ba0 con 0x7f9ee00b6140 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.379+0000 7f9ee7800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee00b6810 con 0x7f9ee00d1a50 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7f0456a00640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04400763d0 0x7f0440078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f044c0b85f0 con 0x7f0458051c80 2024-05-04T07:50:53.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6fe4046070 con 0x7f6ff00e4500 2024-05-04T07:50:53.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7fb838600640 1 -- start start 2024-05-04T07:50:53.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7f0456a00640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f044007fb50 0x7f0440081f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.419 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f045ea00640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04400763d0 0x7f0440078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 0x7fb8300b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8300d1740 0x7fb8300c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb83015b320 0x7fb8301fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300cf640 con 0x7fb8300d1740 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300cf360 con 0x7fb8300cc080 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fb838600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300d00a0 con 0x7fb83015b320 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7f9edfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 0x7f9ee00cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7f9edfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 0x7f9ee00cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39040/0 (socket says 172.21.15.136:39040) 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7f9edfe00640 1 -- 172.21.15.136:0/274022979 learned_addr learned my addr 172.21.15.136:0/274022979 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.380+0000 7f9ee5800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ee00d1a50 0x7f9ee00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f8a70000640 1 Processor -- start 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7f9ee4e00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00b6140 0x7f9ee0072fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9ee5800640 1 -- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00b6140 msgr2=0x7f9ee0072fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9ee5800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ee00b6140 0x7f9ee0072fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9ee5800640 1 -- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 msgr2=0x7f9ee00cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9ee5800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 0x7f9ee00cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9ee5800640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee00ccee0 con 0x7f9ee00d1a50 2024-05-04T07:50:53.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.381+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd91801a070 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f9edfe00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ee00c9cc0 0x7f9ee00cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.382+0000 7f8a70000640 1 -- start start 2024-05-04T07:50:53.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f044c03fe50 con 0x7f044007fb50 2024-05-04T07:50:53.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f044c0b89e0 con 0x7f0458051c80 2024-05-04T07:50:53.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7fb835c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 0x7fb8300b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7fb835200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8300d1740 0x7fb8300c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f9ee5800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ee00d1a50 0x7f9ee00b6b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c710 tx=0x7f9ed800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f6fee000640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6fd80762d0 0x7f6fd8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7fb835c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 0x7fb8300b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46520/0 (socket says 172.21.15.136:46520) 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7fb836600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb83015b320 0x7fb8301fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7fb835c00640 1 -- 172.21.15.136:0/1635768306 learned_addr learned my addr 172.21.15.136:0/1635768306 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f045ea00640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04400763d0 0x7f0440078890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0460052040 tx=0x7f046008cf90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f045e000640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f044007fb50 0x7f0440081f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.383+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6fe40b7cd0 con 0x7f6ff00e4500 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f6fee000640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7f6fd807fa40 0x7f6fd8081e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fe404ee50 con 0x7f6fd807fa40 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6fe40b80c0 con 0x7f6ff00e4500 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f6ff9e00640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6fd80762d0 0x7f6fd8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68071ed0 0x7f8a680b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680cb7b0 0x7f8a680ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 0x7f8a68153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68166e00 con 0x7f8a680ce820 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a680cf8f0 con 0x7f8a68071ed0 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f8a70000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8a680d08c0 con 0x7f8a680cb7b0 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7fd922000640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd90c076320 0x7fd90c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd918097310 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fd922000640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fd90c07faa0 0x7fd90c081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd918020ec0 con 0x7fd90c07faa0 2024-05-04T07:50:53.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd9180976c0 con 0x7fd92c0cb7b0 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.384+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8017070 con 0x7f9ee00d1a50 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed800ce20 con 0x7f9ee00d1a50 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800a840 con 0x7f9ee00d1a50 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee00cd180 con 0x7f9ee00d1a50 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f8a6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 0x7f8a68153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f8a6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 0x7f8a68153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39058/0 (socket says 172.21.15.136:39058) 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f8a6e000640 1 -- 172.21.15.136:0/1356949244 learned_addr learned my addr 172.21.15.136:0/1356949244 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f8a6cc00640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680cb7b0 0x7f8a680ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f8a6d600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68071ed0 0x7f8a680b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7f6ff9e00640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6fd80762d0 0x7f6fd8078790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0057780 tx=0x7f6fe8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fb835c00640 1 -- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb83015b320 msgr2=0x7fb8301fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fb835c00640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb83015b320 0x7fb8301fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fb835c00640 1 -- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8300d1740 msgr2=0x7fb8300c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fb835c00640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8300d1740 0x7fb8300c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 -- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680cb7b0 msgr2=0x7f8a680ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a680cb7b0 0x7f8a680ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 -- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 msgr2=0x7f8a68153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.385+0000 7fd929e00640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd90c076320 0x7fd90c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7fd92a800640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fd90c07faa0 0x7fd90c081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7fb835c00640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8301fcdc0 con 0x7fb8300cc080 2024-05-04T07:50:53.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 0x7f8a68153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a680b3e60 con 0x7f8a68071ed0 2024-05-04T07:50:53.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6e000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a680ce820 0x7f8a68153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee00cd740 con 0x7f9ee00d1a50 2024-05-04T07:50:53.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f6ffa800640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7f6fd807fa40 0x7f6fd8081e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7fb835200640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8300d1740 0x7fb8300c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7fb835c00640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 0x7fb8300b4df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb828009db0 tx=0x7fb82800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7f8a6d600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68071ed0 0x7f8a680b4f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b38c0 tx=0x7f8a540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f045e000640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f044007fb50 0x7f0440081f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7fd92a800640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fd90c07faa0 0x7fd90c081ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9ee0069470 con 0x7f9ee00d1a50 2024-05-04T07:50:53.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.386+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fccb001a070 con 0x7fccb80cc080 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7fd929e00640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd90c076320 0x7fd90c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005880 tx=0x7fd91c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828018020 con 0x7fb8300cc080 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828014480 con 0x7fb8300cc080 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037050 con 0x7f8a68071ed0 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a54038040 con 0x7f8a68071ed0 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a680b4140 con 0x7f8a68071ed0 2024-05-04T07:50:53.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.387+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a680b4700 con 0x7f8a68071ed0 2024-05-04T07:50:53.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8301fd0a0 con 0x7fb8300cc080 2024-05-04T07:50:53.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7f6ffa800640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7f6fd807fa40 0x7f6fd8081e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5403c8f0 con 0x7f8a68071ed0 2024-05-04T07:50:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828014850 con 0x7fb8300cc080 2024-05-04T07:50:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== osd.2 v2:172.21.15.136:6824/2411296812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd918020ec0 con 0x7fd90c07faa0 2024-05-04T07:50:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.389+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== osd.1 v2:172.21.15.136:6800/1755931055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f044c03fe50 con 0x7f044007fb50 2024-05-04T07:50:53.435 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.388+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a44001030 con 0x7f8a68071ed0 2024-05-04T07:50:53.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.389+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83016d3f0 con 0x7fb8300cc080 2024-05-04T07:50:53.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.389+0000 7fccaf400640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcc980762d0 0x7fcc98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.436 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.389+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fccb00976e0 con 0x7fccb80cc080 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.390+0000 7fccb6a00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcc980762d0 0x7fcc98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.390+0000 7fccaf400640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7fcc9807fa40 0x7fcc98081e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.390+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccb0022e50 con 0x7fcc9807fa40 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.390+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fccb0097ad0 con 0x7fccb80cc080 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.391+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== osd.4 v2:172.21.15.142:6808/2527007446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fe404ee50 con 0x7f6fd807fa40 2024-05-04T07:50:53.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.391+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ed801a070 con 0x7f9ee00d1a50 2024-05-04T07:50:53.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.391+0000 7fccb7e00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7fcc9807fa40 0x7fcc98081e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.391+0000 7fccb6a00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcc980762d0 0x7fcc98078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcca8034000 tx=0x7fcca802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.391+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8301fd2e0 con 0x7fb8300cc080 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.392+0000 7f9edcc00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9ec00763a0 0x7f9ec0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9ed8097210 con 0x7f9ee00d1a50 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7f9edcc00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f9ec007fb20 0x7f9ec0081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ed801dec0 con 0x7f9ec007fb20 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9ed8097600 con 0x7f9ee00d1a50 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.394+0000 7f9ee4e00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9ec00763a0 0x7f9ec0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.439 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb828005d10 con 0x7fb8300cc080 2024-05-04T07:50:53.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.392+0000 7fccb7e00640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7fcc9807fa40 0x7fcc98081e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.394+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== osd.3 v2:172.21.15.136:6816/2323540888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccb0022e50 con 0x7fcc9807fa40 2024-05-04T07:50:53.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.393+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a54045020 con 0x7f8a68071ed0 2024-05-04T07:50:53.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7fb82d600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb8100763a0 0x7fb810078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7f8a65600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a48076320 0x7f8a480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a540b8840 con 0x7f8a68071ed0 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb8280982f0 con 0x7fb8300cc080 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7fb82d600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7fb81007fb20 0x7fb810081f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb82800be50 con 0x7fb81007fb20 2024-05-04T07:50:53.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb82809f050 con 0x7fb8300cc080 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7f9edfe00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f9ec007fb20 0x7f9ec0081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.395+0000 7f9ee4e00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9ec00763a0 0x7f9ec0078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc034000 tx=0x7f9ecc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7fb835200640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb8100763a0 0x7fb810078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7f8a65600640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f8a4807faa0 0x7f8a48081ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7f8a6cc00640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a48076320 0x7f8a480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a5403ce50 con 0x7f8a4807faa0 2024-05-04T07:50:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a540b8c30 con 0x7f8a68071ed0 2024-05-04T07:50:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7f9edfe00640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f9ec007fb20 0x7f9ec0081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.396+0000 7fb836600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7fb81007fb20 0x7fb810081f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.397+0000 7f8a6e000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f8a4807faa0 0x7f8a48081ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.397+0000 7fb835200640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb8100763a0 0x7fb810078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb81c034000 tx=0x7fb81c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.398+0000 7fb836600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7fb81007fb20 0x7fb810081f60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.398+0000 7f8a6e000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f8a4807faa0 0x7f8a48081ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.399+0000 7f8a6cc00640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a48076320 0x7f8a480787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a6815d6c0 tx=0x7f8a5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.399+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== osd.6 v2:172.21.15.142:6816/3988723110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ed801dec0 con 0x7f9ec007fb20 2024-05-04T07:50:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.400+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== osd.5 v2:172.21.15.142:6800/2745467739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb82800be50 con 0x7fb81007fb20 2024-05-04T07:50:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.401+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== osd.7 v2:172.21.15.142:6824/1595351280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a5403ce50 con 0x7f8a4807faa0 2024-05-04T07:50:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.407+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 --> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a8c069470 con 0x7f9a6807fb20 2024-05-04T07:50:53.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.408+0000 7f9a82000640 1 -- 172.21.15.136:0/3469034044 <== osd.0 v2:172.21.15.136:6801/3794668031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a8c069470 con 0x7f9a6807fb20 2024-05-04T07:50:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f9a6807fb20 msgr2=0x7f9a68081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f9a6807fb20 0x7f9a68081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a680763a0 msgr2=0x7f9a68078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a680763a0 0x7f9a68078860 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0b3990 tx=0x7f9a74008040 comp rx=0 tx=0).stop 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 msgr2=0x7f9a8c09fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a90c00640 1 --2- 172.21.15.136:0/3469034044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a8c0b63f0 0x7f9a8c09fe70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c7c0 tx=0x7f9a8400cc80 comp rx=0 tx=0).stop 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.409+0000 7f9a8a800640 1 -- 172.21.15.136:0/3469034044 reap_dead start 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.410+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 shutdown_connections 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.410+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 >> 172.21.15.136:0/3469034044 conn(0x7f9a8c0d4fb0 msgr2=0x7f9a8c1ef0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.410+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 shutdown_connections 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.410+0000 7f9a90c00640 1 -- 172.21.15.136:0/3469034044 wait complete. 2024-05-04T07:50:53.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.419+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 --> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f045803a380 con 0x7f044007fb50 2024-05-04T07:50:53.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.421+0000 7fd931000640 1 -- 172.21.15.136:0/803796321 --> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd92c069470 con 0x7fd90c07faa0 2024-05-04T07:50:53.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.421+0000 7fd922000640 1 -- 172.21.15.136:0/803796321 <== osd.2 v2:172.21.15.136:6824/2411296812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd92c069470 con 0x7fd90c07faa0 2024-05-04T07:50:53.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.421+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 --> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ff00104c0 con 0x7f6fd807fa40 2024-05-04T07:50:53.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.422+0000 7f6fee000640 1 -- 172.21.15.136:0/1490150276 <== osd.4 v2:172.21.15.142:6808/2527007446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ff00104c0 con 0x7f6fd807fa40 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.422+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7f6fd807fa40 msgr2=0x7f6fd8081e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.422+0000 7f6ffb200640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7f6fd807fa40 0x7f6fd8081e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6fd80762d0 msgr2=0x7f6fd8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6fd80762d0 0x7f6fd8078790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0057780 tx=0x7f6fe8008040 comp rx=0 tx=0).stop 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 msgr2=0x7f6ff0056dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 --2- 172.21.15.136:0/1490150276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ff00e4500 0x7f6ff0056dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4038040 tx=0x7f6fe40046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fd90c07faa0 msgr2=0x7fd90c081ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fd90c07faa0 0x7fd90c081ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f0456a00640 1 -- 172.21.15.136:0/3460967163 <== osd.1 v2:172.21.15.136:6800/1755931055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f045803a380 con 0x7f044007fb50 2024-05-04T07:50:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f044007fb50 msgr2=0x7f0440081f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd90c076320 msgr2=0x7fd90c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd90c076320 0x7fd90c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd91c005880 tx=0x7fd91c009040 comp rx=0 tx=0).stop 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 msgr2=0x7fd92c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7fd917400640 1 --2- 172.21.15.136:0/803796321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd92c0cb7b0 0x7fd92c0c9a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c390 tx=0x7fd91800c850 comp rx=0 tx=0).stop 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7fd92a800640 1 -- 172.21.15.136:0/803796321 reap_dead start 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 shutdown_connections 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 >> 172.21.15.136:0/803796321 conn(0x7fd92c0d0c50 msgr2=0x7fd92c0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 shutdown_connections 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7fd917400640 1 -- 172.21.15.136:0/803796321 wait complete. 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffa800640 1 -- 172.21.15.136:0/1490150276 reap_dead start 2024-05-04T07:50:53.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 shutdown_connections 2024-05-04T07:50:53.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.423+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 >> 172.21.15.136:0/1490150276 conn(0x7f6ff0020040 msgr2=0x7f6ff00345b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7f0465800640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f044007fb50 0x7f0440081f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.424+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 shutdown_connections 2024-05-04T07:50:53.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04400763d0 msgr2=0x7f0440078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f6ffb200640 1 -- 172.21.15.136:0/1490150276 wait complete. 2024-05-04T07:50:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04400763d0 0x7f0440078890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0460052040 tx=0x7f046008cf90 comp rx=0 tx=0).stop 2024-05-04T07:50:53.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 msgr2=0x7f045804e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 --2- 172.21.15.136:0/3460967163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0458051c80 0x7f045804e080 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f044c000c00 tx=0x7f044c0047d0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f045f400640 1 -- 172.21.15.136:0/3460967163 reap_dead start 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 shutdown_connections 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.425+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 >> 172.21.15.136:0/3460967163 conn(0x7f0458058ee0 msgr2=0x7f04580e6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.426+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 shutdown_connections 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.426+0000 7f0465800640 1 -- 172.21.15.136:0/3460967163 wait complete. 2024-05-04T07:50:53.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.427+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 --> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccb81586d0 con 0x7fcc9807fa40 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.428+0000 7fccaf400640 1 -- 172.21.15.136:0/310997662 <== osd.3 v2:172.21.15.136:6816/2323540888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccb81586d0 con 0x7fcc9807fa40 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.429+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7fcc9807fa40 msgr2=0x7fcc98081e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.429+0000 7fccbe200640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7fcc9807fa40 0x7fcc98081e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcc980762d0 msgr2=0x7fcc98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcc980762d0 0x7fcc98078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcca8034000 tx=0x7fcca802e000 comp rx=0 tx=0).stop 2024-05-04T07:50:53.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 msgr2=0x7fccb80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 --2- 172.21.15.136:0/310997662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80cc080 0x7fccb80c9b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c7a0 tx=0x7fccb000cc60 comp rx=0 tx=0).stop 2024-05-04T07:50:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccb7e00640 1 -- 172.21.15.136:0/310997662 reap_dead start 2024-05-04T07:50:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 shutdown_connections 2024-05-04T07:50:53.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.430+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 >> 172.21.15.136:0/310997662 conn(0x7fccb80d0c50 msgr2=0x7fccb8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.456 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:53.457 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T07:50:53.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.431+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 --> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a44002dd0 con 0x7f8a4807faa0 2024-05-04T07:50:53.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.431+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 shutdown_connections 2024-05-04T07:50:53.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.432+0000 7fccbe200640 1 -- 172.21.15.136:0/310997662 wait complete. 2024-05-04T07:50:53.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.433+0000 7f8a65600640 1 -- 172.21.15.136:0/1356949244 <== osd.7 v2:172.21.15.142:6824/1595351280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a44002dd0 con 0x7f8a4807faa0 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.433+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f8a4807faa0 msgr2=0x7f8a48081ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.433+0000 7f8a70000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f8a4807faa0 0x7f8a48081ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a48076320 msgr2=0x7f8a480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a48076320 0x7f8a480787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a6815d6c0 tx=0x7f8a5c009040 comp rx=0 tx=0).stop 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68071ed0 msgr2=0x7f8a680b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 --2- 172.21.15.136:0/1356949244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a68071ed0 0x7f8a680b4f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b38c0 tx=0x7f8a540046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a6e000640 1 -- 172.21.15.136:0/1356949244 reap_dead start 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 shutdown_connections 2024-05-04T07:50:53.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.434+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 >> 172.21.15.136:0/1356949244 conn(0x7f8a680d0c50 msgr2=0x7f8a680d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.437+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 --> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9ee00d3ee0 con 0x7f9ec007fb20 2024-05-04T07:50:53.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.437+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 shutdown_connections 2024-05-04T07:50:53.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.437+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 --> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb830069470 con 0x7fb81007fb20 2024-05-04T07:50:53.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.437+0000 7f8a70000640 1 -- 172.21.15.136:0/1356949244 wait complete. 2024-05-04T07:50:53.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.438+0000 7f9edcc00640 1 -- 172.21.15.136:0/274022979 <== osd.6 v2:172.21.15.142:6816/3988723110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9ee00d3ee0 con 0x7f9ec007fb20 2024-05-04T07:50:53.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.438+0000 7fb82d600640 1 -- 172.21.15.136:0/1635768306 <== osd.5 v2:172.21.15.142:6800/2745467739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb830069470 con 0x7fb81007fb20 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.438+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f9ec007fb20 msgr2=0x7f9ec0081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.438+0000 7f9ee7800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f9ec007fb20 0x7f9ec0081f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9ec00763a0 msgr2=0x7f9ec0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9ec00763a0 0x7f9ec0078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc034000 tx=0x7f9ecc02e000 comp rx=0 tx=0).stop 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ee00d1a50 msgr2=0x7f9ee00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 --2- 172.21.15.136:0/274022979 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ee00d1a50 0x7f9ee00b6b00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c710 tx=0x7f9ed800cbd0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee5800640 1 -- 172.21.15.136:0/274022979 reap_dead start 2024-05-04T07:50:53.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 shutdown_connections 2024-05-04T07:50:53.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 >> 172.21.15.136:0/274022979 conn(0x7f9ee00d5080 msgr2=0x7f9ee00d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.439+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 shutdown_connections 2024-05-04T07:50:53.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7f9ee7800640 1 -- 172.21.15.136:0/274022979 wait complete. 2024-05-04T07:50:53.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7fb81007fb20 msgr2=0x7fb810081f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7fb81007fb20 0x7fb810081f60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb8100763a0 msgr2=0x7fb810078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb8100763a0 0x7fb810078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb81c034000 tx=0x7fb81c02e000 comp rx=0 tx=0).stop 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 msgr2=0x7fb8300b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb838600640 1 --2- 172.21.15.136:0/1635768306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8300cc080 0x7fb8300b4df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb828009db0 tx=0x7fb82800c490 comp rx=0 tx=0).stop 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.440+0000 7fb836600640 1 -- 172.21.15.136:0/1635768306 reap_dead start 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.441+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 shutdown_connections 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.441+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 >> 172.21.15.136:0/1635768306 conn(0x7fb8300d0c50 msgr2=0x7fb830075a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.441+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 shutdown_connections 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.441+0000 7fb838600640 1 -- 172.21.15.136:0/1635768306 wait complete. 2024-05-04T07:50:53.464 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:53.465 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:53.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T07:50:53.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T07:50:53.467 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:53.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T07:50:53.468 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:53.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T07:50:53.469 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:53.469 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T07:50:53.470 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:53.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T07:50:53.471 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:53.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T07:50:53.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.745+0000 7f2bbce00640 1 Processor -- start 2024-05-04T07:50:53.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.746+0000 7f2bbce00640 1 -- start start 2024-05-04T07:50:53.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.747+0000 7f8dd9400640 1 Processor -- start 2024-05-04T07:50:53.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.748+0000 7f8dd9400640 1 -- start start 2024-05-04T07:50:53.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.747+0000 7fa4bd800640 1 Processor -- start 2024-05-04T07:50:53.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.748+0000 7fa4bd800640 1 -- start start 2024-05-04T07:50:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.748+0000 7f2bbce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2bb815b680 0x7f2bb80cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7f2bbce00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb815ba60 con 0x7f2bb806c3a0 2024-05-04T07:50:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7f2bbce00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb806c800 con 0x7f2bb80d03d0 2024-05-04T07:50:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7f2bbce00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb80cd8e0 con 0x7f2bb815b680 2024-05-04T07:50:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80b5340 0x7fa4b80d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7fa4bd800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4b80c99c0 0x7fa4b80d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7fa4bd800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80d5bd0 con 0x7fa4b80b5a80 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7fa4bd800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b80d0b60 con 0x7fa4b80c99c0 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.749+0000 7fa4bd800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80d5980 con 0x7fa4b80b5340 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7f2bb5400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2bb806c3a0 0x7f2bb80cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41530/0 (socket says 172.21.15.136:41530) 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7f2bb5400640 1 -- 172.21.15.136:0/2484118869 learned_addr learned my addr 172.21.15.136:0/2484118869 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7f2bb5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2bb815b680 0x7f2bb80cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7fa4b7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80b5340 0x7fa4b80d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7fa4bce00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4b80c99c0 0x7fa4b80d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7fa4b7400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa4b80b5a80 0x7fa4b80d2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:42846/0 (socket says 172.21.15.136:42846) 2024-05-04T07:50:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.750+0000 7fa4b7400640 1 -- 172.21.15.136:0/2052603124 learned_addr learned my addr 172.21.15.136:0/2052603124 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950814392 0 0) 0x7f2bb806c800 con 0x7f2bb80d03d0 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b9c003520 con 0x7f2bb80d03d0 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029585889 0 0) 0x7f2bb815ba60 con 0x7f2bb806c3a0 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bb806c800 con 0x7f2bb806c3a0 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb5e00640 1 -- 172.21.15.136:0/2484118869 >> v1:172.21.15.142:6789/0 conn(0x7f2bb80d03d0 legacy=0x7f2bb80c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb5e00640 1 -- 172.21.15.136:0/2484118869 >> v1:172.21.15.136:6789/0 conn(0x7f2bb806c3a0 legacy=0x7f2bb80cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.751+0000 7f2bb5e00640 1 -- 172.21.15.136:0/2484118869 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80cd600 con 0x7f2bb815b680 2024-05-04T07:50:53.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7fa4bce00640 1 -- 172.21.15.136:0/2052603124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80b5340 msgr2=0x7fa4b80d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7fa4bce00640 1 --2- 172.21.15.136:0/2052603124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80b5340 0x7fa4b80d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7fa4bce00640 1 -- 172.21.15.136:0/2052603124 >> v1:172.21.15.142:6789/0 conn(0x7fa4b80b5a80 legacy=0x7fa4b80d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7fa4bce00640 1 -- 172.21.15.136:0/2052603124 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80d07f0 con 0x7fa4b80c99c0 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7fa4b6a00640 1 -- 172.21.15.136:0/2052603124 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790298867 0 0) 0x7fa4b80d5bd0 con 0x7fa4b80b5a80 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7f8dd9400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8dcc0e1310 0x7f8dcc03a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7f8dd9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc009d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7f8dd9400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dcc03a6b0 con 0x7f8dcc0516e0 2024-05-04T07:50:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f8dd9400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8dcc055920 con 0x7f8dcc0e1310 2024-05-04T07:50:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f8dd9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc054d10 con 0x7f8dcc00ab40 2024-05-04T07:50:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7feb57200640 1 Processor -- start 2024-05-04T07:50:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.752+0000 7feb57200640 1 -- start start 2024-05-04T07:50:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f2bb5e00640 1 --2- 172.21.15.136:0/2484118869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb80cd020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40097a0 tx=0x7f2ba402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1214284d8a74a9c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f8dd3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8dcc0e1310 0x7f8dcc03a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f8dd3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8dcc0e1310 0x7f8dcc03a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46538/0 (socket says 172.21.15.136:46538) 2024-05-04T07:50:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7f8dd3e00640 1 -- 172.21.15.136:0/481793767 learned_addr learned my addr 172.21.15.136:0/481793767 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.753+0000 7fa4bce00640 1 --2- 172.21.15.136:0/2052603124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80c99c0 0x7fa4b80d1ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097a0 tx=0x7fa4a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78dbdb3770e6972 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4037070 con 0x7f2bb815b680 2024-05-04T07:50:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba402ae50 con 0x7f2bb815b680 2024-05-04T07:50:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f2bb4a00640 1 -- 172.21.15.136:0/2484118869 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4032640 con 0x7f2bb815b680 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7fa4b6a00640 1 -- 172.21.15.136:0/2052603124 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4037070 con 0x7fa4b80c99c0 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7fa4b6a00640 1 -- 172.21.15.136:0/2052603124 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4032440 con 0x7fa4b80c99c0 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7fa4b6a00640 1 -- 172.21.15.136:0/2052603124 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4032810 con 0x7fa4b80c99c0 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f8dd2a00640 1 -- 172.21.15.136:0/481793767 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905114977 0 0) 0x7f8dcc03a6b0 con 0x7f8dcc0516e0 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f8dd2a00640 1 -- 172.21.15.136:0/481793767 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dbc003520 con 0x7f8dcc0516e0 2024-05-04T07:50:53.758 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.755+0000 7f2bbce00640 1 -- 172.21.15.136:0/2484118869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 msgr2=0x7f2bb80cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.755+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2484118869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb80cd020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40097a0 tx=0x7f2ba402a100 comp rx=0 tx=0).stop 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.755+0000 7fa4bd800640 1 -- 172.21.15.136:0/2052603124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80c99c0 msgr2=0x7fa4b80d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.755+0000 7fa4bd800640 1 --2- 172.21.15.136:0/2052603124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80c99c0 0x7fa4b80d1ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097a0 tx=0x7fa4a402a180 comp rx=0 tx=0).stop 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f8dd3e00640 1 -- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 msgr2=0x7f8dcc009d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 -- 172.21.15.136:0/2052603124 shutdown_connections 2024-05-04T07:50:53.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 --2- 172.21.15.136:0/2052603124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80c99c0 0x7fa4b80d1ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 --2- 172.21.15.136:0/2052603124 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80b5340 0x7fa4b80d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 -- 172.21.15.136:0/2052603124 >> 172.21.15.136:0/2052603124 conn(0x7fa4b80d4e60 msgr2=0x7fa4b80d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb57200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 0x7feb5004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb57200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb50038720 0x7feb50006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb57200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50048420 con 0x7feb50037bb0 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb57200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7feb500547a0 con 0x7feb50038720 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb57200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feb50053700 con 0x7feb50048040 2024-05-04T07:50:53.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f8dd3e00640 1 --2- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.754+0000 7f8dd3e00640 1 -- 172.21.15.136:0/481793767 >> v1:172.21.15.142:6789/0 conn(0x7f8dcc0516e0 legacy=0x7f8dcc055db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.755+0000 7f8dd3e00640 1 -- 172.21.15.136:0/481793767 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc054ff0 con 0x7f8dcc0e1310 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7f2bbce00640 1 -- 172.21.15.136:0/2484118869 shutdown_connections 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2484118869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb80cd020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7f2bbce00640 1 -- 172.21.15.136:0/2484118869 >> 172.21.15.136:0/2484118869 conn(0x7f2bb80cdf60 msgr2=0x7f2bb80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7f8dd3e00640 1 --2- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc03a170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009870 tx=0x7f8dc802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ea3c20127a08f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb55e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 0x7feb5004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb56800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb50038720 0x7feb50006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7feb55e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 0x7feb5004fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46554/0 (socket says 172.21.15.136:46554) 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7feb55e00640 1 -- 172.21.15.136:0/1730143436 learned_addr learned my addr 172.21.15.136:0/1730143436 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 -- 172.21.15.136:0/2052603124 shutdown_connections 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.756+0000 7fa4bd800640 1 -- 172.21.15.136:0/2052603124 wait complete. 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7fa4bd800640 1 Processor -- start 2024-05-04T07:50:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7feb56800640 1 -- 172.21.15.136:0/1730143436 >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 msgr2=0x7feb5004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7feb56800640 1 --2- 172.21.15.136:0/1730143436 >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 0x7feb5004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7feb56800640 1 -- 172.21.15.136:0/1730143436 >> v1:172.21.15.136:6789/0 conn(0x7feb50037bb0 legacy=0x7feb50038010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7feb56800640 1 -- 172.21.15.136:0/1730143436 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb500539e0 con 0x7feb50038720 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7f8dd2a00640 1 -- 172.21.15.136:0/481793767 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8037070 con 0x7f8dcc0e1310 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7f8dd2a00640 1 -- 172.21.15.136:0/481793767 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc8032440 con 0x7f8dcc0e1310 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7f8dd2a00640 1 -- 172.21.15.136:0/481793767 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8032810 con 0x7f8dcc0e1310 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 -- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0e1310 msgr2=0x7f8dcc03a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 --2- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc03a170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009870 tx=0x7f8dc802a270 comp rx=0 tx=0).stop 2024-05-04T07:50:53.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7fab4fa00640 1 Processor -- start 2024-05-04T07:50:53.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7fab4fa00640 1 -- start start 2024-05-04T07:50:53.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f9f60e00640 1 Processor -- start 2024-05-04T07:50:53.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f9f60e00640 1 -- start start 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.757+0000 7f2bbce00640 1 -- 172.21.15.136:0/2484118869 shutdown_connections 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7f2bbce00640 1 -- 172.21.15.136:0/2484118869 wait complete. 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 -- 172.21.15.136:0/481793767 shutdown_connections 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 --2- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc009d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 --2- 172.21.15.136:0/481793767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc03a170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.759+0000 7f8dd9400640 1 -- 172.21.15.136:0/481793767 >> 172.21.15.136:0/481793767 conn(0x7f8dcc056cd0 msgr2=0x7f8dcc0570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab4fa00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab480d1a50 0x7fab4815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab4fa00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab480b6140 0x7fab4815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fa4bd800640 1 -- start start 2024-05-04T07:50:53.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.758+0000 7feb56800640 1 --2- 172.21.15.136:0/1730143436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50038720 0x7feb50006ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb58065ed0 tx=0x7feb5806c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f321c1748dc454b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7feb54a00640 1 -- 172.21.15.136:0/1730143436 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580a75b0 con 0x7feb50038720 2024-05-04T07:50:53.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab4fa00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab480d07d0 con 0x7fab480d1e30 2024-05-04T07:50:53.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab4fa00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fab480d0ab0 con 0x7fab480b6140 2024-05-04T07:50:53.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab4fa00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fab480d0d90 con 0x7fab480d1a50 2024-05-04T07:50:53.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7f8dd9400640 1 -- 172.21.15.136:0/481793767 shutdown_connections 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab47e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab480b6140 0x7fab4815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab47e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab480b6140 0x7fab4815f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39078/0 (socket says 172.21.15.136:39078) 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7fab47e00640 1 -- 172.21.15.136:0/1411225975 learned_addr learned my addr 172.21.15.136:0/1411225975 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7feb54a00640 1 -- 172.21.15.136:0/1730143436 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb580a77d0 con 0x7feb50038720 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.760+0000 7feb54a00640 1 -- 172.21.15.136:0/1730143436 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580a7c80 con 0x7feb50038720 2024-05-04T07:50:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7f8dd9400640 1 -- 172.21.15.136:0/481793767 wait complete. 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7f9f60e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9f5c15f8a0 0x7f9f5c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fab47e00640 1 -- 172.21.15.136:0/1411225975 >> v2:172.21.15.142:3300/0 conn(0x7fab480d1a50 msgr2=0x7fab4815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fab47e00640 1 --2- 172.21.15.136:0/1411225975 >> v2:172.21.15.142:3300/0 conn(0x7fab480d1a50 0x7fab4815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fab47e00640 1 -- 172.21.15.136:0/1411225975 >> v1:172.21.15.142:6789/0 conn(0x7fab480d1e30 legacy=0x7fab480d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fab47e00640 1 -- 172.21.15.136:0/1411225975 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab480d5eb0 con 0x7fab480b6140 2024-05-04T07:50:53.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fe829400640 1 Processor -- start 2024-05-04T07:50:53.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7feb57200640 1 -- 172.21.15.136:0/1730143436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50038720 msgr2=0x7feb50006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7feb57200640 1 --2- 172.21.15.136:0/1730143436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50038720 0x7feb50006ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb58065ed0 tx=0x7feb5806c2d0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7f9f60e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9f5c0b6140 0x7f9f5c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fe829400640 1 -- start start 2024-05-04T07:50:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7f0ca2200640 1 Processor -- start 2024-05-04T07:50:53.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7f9f59e00640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9f5c0d1a50 0x7f9f5c15f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:42874/0 (socket says 172.21.15.136:42874) 2024-05-04T07:50:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7f9f59e00640 1 -- 172.21.15.136:0/1023056198 learned_addr learned my addr 172.21.15.136:0/1023056198 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f0ca2200640 1 -- start start 2024-05-04T07:50:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f8dd9400640 1 Processor -- start 2024-05-04T07:50:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80c99c0 0x7fa4b80ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b80baaf0 0x7fa4b80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80b58a0 con 0x7fa4b80b5340 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b80b5720 con 0x7fa4b80baaf0 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.761+0000 7fa4bd800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b80b5fd0 con 0x7fa4b80c99c0 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 -- 172.21.15.136:0/1730143436 shutdown_connections 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 --2- 172.21.15.136:0/1730143436 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50038720 0x7feb50006ea0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 --2- 172.21.15.136:0/1730143436 >> v2:172.21.15.142:3300/0 conn(0x7feb50048040 0x7feb5004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 -- 172.21.15.136:0/1730143436 >> 172.21.15.136:0/1730143436 conn(0x7feb50009fb0 msgr2=0x7feb5000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fa4b7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fa4b7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39108/0 (socket says 172.21.15.136:39108) 2024-05-04T07:50:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fa4b7e00640 1 -- 172.21.15.136:0/1104820012 learned_addr learned my addr 172.21.15.136:0/1104820012 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fa4b7400640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80c99c0 0x7fa4b80ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.762+0000 7fa4bce00640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b80baaf0 0x7fa4b80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 -- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80c99c0 msgr2=0x7fa4b80ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80c99c0 0x7fa4b80ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 -- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b80baaf0 msgr2=0x7fa4b80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b80baaf0 0x7fa4b80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 -- 172.21.15.136:0/1104820012 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80b2660 con 0x7fa4b80b5340 2024-05-04T07:50:53.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4b7e00640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800e9b0 tx=0x7fa4a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 -- 172.21.15.136:0/1730143436 shutdown_connections 2024-05-04T07:50:53.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8017070 con 0x7fa4b80b5340 2024-05-04T07:50:53.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7feb57200640 1 -- 172.21.15.136:0/1730143436 wait complete. 2024-05-04T07:50:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a800c9a0 con 0x7fa4b80b5340 2024-05-04T07:50:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a800cd90 con 0x7fa4b80b5340 2024-05-04T07:50:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b80b2940 con 0x7fa4b80b5340 2024-05-04T07:50:53.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b80cbf30 con 0x7fa4b80b5340 2024-05-04T07:50:53.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7f8dd9400640 1 -- start start 2024-05-04T07:50:53.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe829400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe82415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe829400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8240b6140 0x7fe82415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe829400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8240d07d0 con 0x7fe8240d1e30 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe829400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe8240d0ab0 con 0x7fe8240b6140 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe829400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240d0d90 con 0x7fe8240d1a50 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe81be00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe8240b6140 0x7fe82415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe823200640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe8240d1e30 0x7fe8240d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41536/0 (socket says 172.21.15.136:41536) 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fe823200640 1 -- 172.21.15.136:0/1533558018 learned_addr learned my addr 172.21.15.136:0/1533558018 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7fe822800640 1 --2- 172.21.15.136:0/1533558018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe82415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7fab47e00640 1 --2- 172.21.15.136:0/1411225975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480b6140 0x7fab4815f6d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fab480b7c50 tx=0x7fab3802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f3da3a792c6c42 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7f2bbce00640 1 Processor -- start 2024-05-04T07:50:53.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f9f5a800640 1 --2- 172.21.15.136:0/1023056198 >> v2:172.21.15.142:3300/0 conn(0x7f9f5c0b6140 0x7f9f5c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f9f59400640 1 --2- 172.21.15.136:0/1023056198 >> v2:172.21.15.136:3300/0 conn(0x7f9f5c15f8a0 0x7f9f5c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f5c0d07d0 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c0d0ab0 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.763+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9f5c0d0d90 con 0x7f9f5c0b6140 2024-05-04T07:50:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.764+0000 7f9f58a00640 1 -- 172.21.15.136:0/1023056198 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526880229 0 0) 0x7f9f5c0d07d0 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0ca2200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0c9c0b4a00 0x7f0c9c0d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0ca2200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c9c0b4000 0x7f0c9c0d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0ca2200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9c0d2280 con 0x7f0c9c1629c0 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0ca2200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c0d2560 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0ca2200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c0d2840 con 0x7f0c9c0b4000 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0c9b400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0c9c1629c0 0x7f0c9c0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41540/0 (socket says 172.21.15.136:41540) 2024-05-04T07:50:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0c9b400640 1 -- 172.21.15.136:0/4210727509 learned_addr learned my addr 172.21.15.136:0/4210727509 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:53.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f0c9aa00640 1 --2- 172.21.15.136:0/4210727509 >> v2:172.21.15.136:3300/0 conn(0x7f0c9c0b4a00 0x7f0c9c0d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7fe822800640 1 -- 172.21.15.136:0/1533558018 >> v2:172.21.15.142:3300/0 conn(0x7fe8240b6140 msgr2=0x7fe82415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7fe822800640 1 --2- 172.21.15.136:0/1533558018 >> v2:172.21.15.142:3300/0 conn(0x7fe8240b6140 0x7fe82415f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7fe822800640 1 -- 172.21.15.136:0/1533558018 >> v1:172.21.15.136:6789/0 conn(0x7fe8240d1e30 legacy=0x7fe8240d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0516e0 0x7f8dcc0e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc0378f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0548a0 con 0x7f8dcc0e1310 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc0555b0 con 0x7f8dcc0516e0 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f8dd9400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc054a20 con 0x7f8dcc00ab40 2024-05-04T07:50:53.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7f9f58a00640 1 -- 172.21.15.136:0/1023056198 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f40003520 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.765+0000 7fe822800640 1 -- 172.21.15.136:0/1533558018 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8240d5eb0 con 0x7fe8240d1a50 2024-05-04T07:50:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7fab47400640 1 -- 172.21.15.136:0/1411225975 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38037070 con 0x7fab480b6140 2024-05-04T07:50:53.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f0c9be00640 1 --2- 172.21.15.136:0/4210727509 >> v2:172.21.15.142:3300/0 conn(0x7f0c9c0b4000 0x7f0c9c0d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7feb57200640 1 Processor -- start 2024-05-04T07:50:53.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34270/0 (socket says 172.21.15.136:34270) 2024-05-04T07:50:53.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f8dd3e00640 1 -- 172.21.15.136:0/1600188575 learned_addr learned my addr 172.21.15.136:0/1600188575 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.790 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f8dd8a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc0378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7fe822800640 1 --2- 172.21.15.136:0/1533558018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe82415f190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1d546cecae8e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f0c9a000640 1 -- 172.21.15.136:0/4210727509 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 961089505 0 0) 0x7f0c9c0d2280 con 0x7f0c9c1629c0 2024-05-04T07:50:53.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f0c9a000640 1 -- 172.21.15.136:0/4210727509 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c80003520 con 0x7f0c9c1629c0 2024-05-04T07:50:53.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7fab47400640 1 -- 172.21.15.136:0/1411225975 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38032440 con 0x7fab480b6140 2024-05-04T07:50:53.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7fab47400640 1 -- 172.21.15.136:0/1411225975 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38032850 con 0x7fab480b6140 2024-05-04T07:50:53.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f0c9aa00640 1 -- 172.21.15.136:0/4210727509 >> v2:172.21.15.142:3300/0 conn(0x7f0c9c0b4000 msgr2=0x7f0c9c0d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7f8dd3400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0516e0 0x7f8dcc0e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 -- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0516e0 msgr2=0x7f8dcc0e4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0516e0 0x7f8dcc0e4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 -- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 msgr2=0x7f8dcc0378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f0c9aa00640 1 --2- 172.21.15.136:0/4210727509 >> v2:172.21.15.142:3300/0 conn(0x7f0c9c0b4000 0x7f0c9c0d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f0c9aa00640 1 -- 172.21.15.136:0/4210727509 >> v1:172.21.15.136:6789/0 conn(0x7f0c9c1629c0 legacy=0x7f0c9c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f0c9aa00640 1 -- 172.21.15.136:0/4210727509 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c0cff10 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc0378f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fab4fa00640 1 -- 172.21.15.136:0/1411225975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480b6140 msgr2=0x7fab4815f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fab4fa00640 1 --2- 172.21.15.136:0/1411225975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480b6140 0x7fab4815f6d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fab480b7c50 tx=0x7fab3802a210 comp rx=0 tx=0).stop 2024-05-04T07:50:53.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fe821e00640 1 -- 172.21.15.136:0/1533558018 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814037070 con 0x7fe8240d1a50 2024-05-04T07:50:53.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fe821e00640 1 -- 172.21.15.136:0/1533558018 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814032440 con 0x7fe8240d1a50 2024-05-04T07:50:53.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fe821e00640 1 -- 172.21.15.136:0/1533558018 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814032810 con 0x7fe8240d1a50 2024-05-04T07:50:53.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 -- 172.21.15.136:0/1600188575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc007e90 con 0x7f8dcc00ab40 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd8a00640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc0378f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f8dd3e00640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009870 tx=0x7f8dc80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7f9f59400640 1 -- 172.21.15.136:0/1023056198 >> v2:172.21.15.142:3300/0 conn(0x7f9f5c0b6140 msgr2=0x7f9f5c0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7f9f59400640 1 --2- 172.21.15.136:0/1023056198 >> v2:172.21.15.142:3300/0 conn(0x7f9f5c0b6140 0x7f9f5c0c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7f9f59400640 1 -- 172.21.15.136:0/1023056198 >> v1:172.21.15.142:6789/0 conn(0x7f9f5c0d1a50 legacy=0x7f9f5c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.766+0000 7f9f59400640 1 -- 172.21.15.136:0/1023056198 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c0d5eb0 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7f2bbce00640 1 -- start start 2024-05-04T07:50:53.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8041070 con 0x7f8dcc00ab40 2024-05-04T07:50:53.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc803c870 con 0x7f8dcc00ab40 2024-05-04T07:50:53.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.768+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa4a801a070 con 0x7fa4b80b5340 2024-05-04T07:50:53.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b8069b10 con 0x7fa4b80b5340 2024-05-04T07:50:53.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7fe829400640 1 -- 172.21.15.136:0/1533558018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 msgr2=0x7fe82415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.767+0000 7feb57200640 1 -- start start 2024-05-04T07:50:53.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7fe829400640 1 --2- 172.21.15.136:0/1533558018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe82415f190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402a180 comp rx=0 tx=0).stop 2024-05-04T07:50:53.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7feb57200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50037bb0 0x7feb5004cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7feb57200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 0x7feb500dcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7feb57200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 0x7feb5017c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fa4afe00640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 0x7fa498078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4a8097d00 con 0x7fa4b80b5340 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fa4b7400640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 0x7fa498078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb55400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 0x7feb500dcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb57200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb50054280 con 0x7feb50037bb0 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb57200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feb50053fa0 con 0x7feb50038720 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb57200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feb5004ffd0 con 0x7feb50048040 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb55400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 0x7feb500dcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:46616/0 (socket says 172.21.15.136:46616) 2024-05-04T07:50:53.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb55400640 1 -- 172.21.15.136:0/1769370498 learned_addr learned my addr 172.21.15.136:0/1769370498 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7feb56800640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 0x7feb5017c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8037040 con 0x7f8dcc00ab40 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dcc008170 con 0x7f8dcc00ab40 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dcc008730 con 0x7f8dcc00ab40 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dcc0057e0 con 0x7f8dcc00ab40 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fab4fa00640 1 -- 172.21.15.136:0/1411225975 shutdown_connections 2024-05-04T07:50:53.800 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fab4fa00640 1 --2- 172.21.15.136:0/1411225975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480b6140 0x7fab4815f6d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fab4fa00640 1 --2- 172.21.15.136:0/1411225975 >> v2:172.21.15.142:3300/0 conn(0x7fab480d1a50 0x7fab4815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7fab4fa00640 1 -- 172.21.15.136:0/1411225975 >> 172.21.15.136:0/1411225975 conn(0x7fab480d5080 msgr2=0x7fab480d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fab4fa00640 1 -- 172.21.15.136:0/1411225975 shutdown_connections 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fab4fa00640 1 -- 172.21.15.136:0/1411225975 wait complete. 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7f9f59400640 1 --2- 172.21.15.136:0/1023056198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c15f8a0 0x7f9f5c0c8cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cf660 tx=0x7f9f4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd73776b99803cdd server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 0x7f2bb806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb81436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80cf7a0 con 0x7f2bb80d03d0 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80cf4c0 con 0x7f2bb815b680 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.769+0000 7f2bbce00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80c6d80 con 0x7f2bb806c3a0 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7f2bb5e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7f2bb5e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:34280/0 (socket says 172.21.15.136:34280) 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7f2bb5e00640 1 -- 172.21.15.136:0/2249331726 learned_addr learned my addr 172.21.15.136:0/2249331726 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.770+0000 7f2bb5400640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 0x7f2bb806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7f2bb6800640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb81436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 -- 172.21.15.136:0/1533558018 shutdown_connections 2024-05-04T07:50:53.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 --2- 172.21.15.136:0/1533558018 >> v2:172.21.15.142:3300/0 conn(0x7fe8240b6140 0x7fe82415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 --2- 172.21.15.136:0/1533558018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe82415f190 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 -- 172.21.15.136:0/1533558018 >> 172.21.15.136:0/1533558018 conn(0x7fe8240d5080 msgr2=0x7fe8240d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7feb55e00640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50037bb0 0x7feb5004cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7f2bb5400640 1 -- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 msgr2=0x7f2bb814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 -- 172.21.15.136:0/1533558018 shutdown_connections 2024-05-04T07:50:53.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7fe829400640 1 -- 172.21.15.136:0/1533558018 wait complete. 2024-05-04T07:50:53.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f0c9aa00640 1 --2- 172.21.15.136:0/4210727509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0d33d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0b3f90 tx=0x7f0c8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18985d5393cd0f84 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.771+0000 7f2bb5400640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7feb56800640 1 -- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 msgr2=0x7feb500dcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7feb56800640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 0x7feb500dcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f2bb5400640 1 -- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 msgr2=0x7f2bb81436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f2bb5400640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb81436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f2bb5400640 1 -- 172.21.15.136:0/2249331726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb814b060 con 0x7f2bb80d03d0 2024-05-04T07:50:53.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f2bb5e00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7f2bb6800640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb81436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:53.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7fa4b7400640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 0x7fa498078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0005fd0 tx=0x7fa4b0007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7feb56800640 1 -- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50037bb0 msgr2=0x7feb5004cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7feb56800640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50037bb0 0x7feb5004cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.773+0000 7f2bb5400640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 0x7f2bb806fd70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c460 tx=0x7f2ba800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.772+0000 7feb56800640 1 -- 172.21.15.136:0/1769370498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5004d730 con 0x7feb50048040 2024-05-04T07:50:53.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.773+0000 7feb56800640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 0x7feb5017c9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb580520f0 tx=0x7feb5806b0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.773+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8dc8044070 con 0x7f8dcc00ab40 2024-05-04T07:50:53.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.774+0000 7fe829400640 1 Processor -- start 2024-05-04T07:50:53.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.774+0000 7fab4fa00640 1 Processor -- start 2024-05-04T07:50:53.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.774+0000 7fe829400640 1 -- start start 2024-05-04T07:50:53.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.774+0000 7fab4fa00640 1 -- start start 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.774+0000 7f8dc7e00640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 0x7f8db4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8dc80b86f0 con 0x7f8dcc00ab40 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7f8dd3400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 0x7f8db4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab480b6140 0x7fab480ba640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 0x7fab480b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab480b6810 con 0x7fab480d1a50 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab480b6690 con 0x7fab480d1e30 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fab4fa00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fab480c9cc0 con 0x7fab480b6140 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe8240ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240d1e30 0x7fe8240ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240b6810 con 0x7fe8240b6140 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240b6690 con 0x7fe8240d1e30 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.775+0000 7fe829400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240c9cc0 con 0x7fe8240d1a50 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fe822800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fe822800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39142/0 (socket says 172.21.15.136:39142) 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fe822800640 1 -- 172.21.15.136:0/434651454 learned_addr learned my addr 172.21.15.136:0/434651454 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fab47e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f8dd3400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 0x7f8db4078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0510b0 tx=0x7f8dc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f9f58a00640 1 -- 172.21.15.136:0/1023056198 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48037070 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8017070 con 0x7f2bb80d03d0 2024-05-04T07:50:53.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8005ce0 con 0x7f2bb80d03d0 2024-05-04T07:50:53.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80072b0 con 0x7f2bb80d03d0 2024-05-04T07:50:53.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fab47e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39158/0 (socket says 172.21.15.136:39158) 2024-05-04T07:50:53.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fab47e00640 1 -- 172.21.15.136:0/2091266149 learned_addr learned my addr 172.21.15.136:0/2091266149 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fab4da00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 0x7fab480b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fab4d000640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab480b6140 0x7fab480ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa4a8061300 con 0x7fa4b80b5340 2024-05-04T07:50:53.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fe81be00640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe8240ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f9f58a00640 1 -- 172.21.15.136:0/1023056198 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f48032440 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb80c8ab0 con 0x7f2bb80d03d0 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb80c9070 con 0x7f2bb80d03d0 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7fe823200640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240d1e30 0x7fe8240ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f0c9a000640 1 -- 172.21.15.136:0/4210727509 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88037070 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f0c9a000640 1 -- 172.21.15.136:0/4210727509 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88032440 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.776+0000 7f0c9a000640 1 -- 172.21.15.136:0/4210727509 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88032810 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7f9f58a00640 1 -- 172.21.15.136:0/1023056198 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4802ae60 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab4da00640 1 -- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab480b6140 msgr2=0x7fab480ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab4da00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab480b6140 0x7fab480ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab4da00640 1 -- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 msgr2=0x7fab480b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab4da00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab4da00640 1 -- 172.21.15.136:0/2091266149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab480b95a0 con 0x7fab480d1e30 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fab47e00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe822800640 1 -- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 msgr2=0x7fe8240ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe822800640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe8240ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe822800640 1 -- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240d1e30 msgr2=0x7fe8240ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe822800640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240d1e30 0x7fe8240ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe822800640 1 -- 172.21.15.136:0/434651454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8240cde10 con 0x7fe8240b6140 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.777+0000 7fe81be00640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe8240ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8069470 con 0x7f2bb80d03d0 2024-05-04T07:50:53.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7fe822800640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe814009890 tx=0x7fe8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7fab4da00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 0x7fab480b8b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab3400c3c0 tx=0x7fab3400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34017070 con 0x7fab480d1e30 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab480b9880 con 0x7fab480d1e30 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab340052d0 con 0x7fab480d1e30 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34003830 con 0x7fab480d1e30 2024-05-04T07:50:53.821 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab480b9e40 con 0x7fab480d1e30 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c15f8a0 msgr2=0x7f9f5c0c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1023056198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c15f8a0 0x7f9f5c0c8cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0cf660 tx=0x7f9f4802a110 comp rx=0 tx=0).stop 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 -- 172.21.15.136:0/4210727509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c0b4a00 msgr2=0x7f0c9c0d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 --2- 172.21.15.136:0/4210727509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0d33d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0b3f90 tx=0x7f0c8802a1a0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 -- 172.21.15.136:0/4210727509 shutdown_connections 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 --2- 172.21.15.136:0/4210727509 >> v2:172.21.15.142:3300/0 conn(0x7f0c9c0b4000 0x7f0c9c0d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 --2- 172.21.15.136:0/4210727509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0d33d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.778+0000 7f0ca2200640 1 -- 172.21.15.136:0/4210727509 >> 172.21.15.136:0/4210727509 conn(0x7f0c9c09e3f0 msgr2=0x7f0c9c0d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f0ca2200640 1 -- 172.21.15.136:0/4210727509 shutdown_connections 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f0ca2200640 1 -- 172.21.15.136:0/4210727509 wait complete. 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814037050 con 0x7fe8240b6140 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814038040 con 0x7fe8240b6140 2024-05-04T07:50:53.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814030930 con 0x7fe8240b6140 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8240ce0f0 con 0x7fe8240b6140 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 shutdown_connections 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1023056198 >> v2:172.21.15.142:3300/0 conn(0x7f9f5c0b6140 0x7f9f5c0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1023056198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c15f8a0 0x7f9f5c0c8cb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 >> 172.21.15.136:0/1023056198 conn(0x7f9f5c0d5080 msgr2=0x7f9f5c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:53.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8240ce6b0 con 0x7fe8240b6140 2024-05-04T07:50:53.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 shutdown_connections 2024-05-04T07:50:53.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.779+0000 7f9f60e00640 1 -- 172.21.15.136:0/1023056198 wait complete. 2024-05-04T07:50:53.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.781+0000 7f0ca2200640 1 Processor -- start 2024-05-04T07:50:53.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.782+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe824069470 con 0x7fe8240b6140 2024-05-04T07:50:53.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.782+0000 7f9f60e00640 1 Processor -- start 2024-05-04T07:50:53.826 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.782+0000 7f9f60e00640 1 -- start start 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.782+0000 7f0ca2200640 1 -- start start 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 0x7f0c9c201910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c162f20 con 0x7f0c9c1629c0 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c162da0 con 0x7f0c9c0b4a00 2024-05-04T07:50:53.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0ca2200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c0d0430 con 0x7f0c9c0b4000 2024-05-04T07:50:53.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ba801a070 con 0x7f2bb80d03d0 2024-05-04T07:50:53.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0c9be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0c9be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39164/0 (socket says 172.21.15.136:39164) 2024-05-04T07:50:53.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0c9be00640 1 -- 172.21.15.136:0/3917434131 learned_addr learned my addr 172.21.15.136:0/3917434131 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.781+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab20005290 con 0x7fab480d1e30 2024-05-04T07:50:53.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab3401a070 con 0x7fab480d1e30 2024-05-04T07:50:53.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.783+0000 7f0c9b400640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 0x7f0c9c201910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f5c0b6140 0x7f9f5c2010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5c15f8a0 0x7f9f5c0ba260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0b6810 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c0b6690 con 0x7f9f5c0b6140 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f60e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c0d1e30 con 0x7f9f5c15f8a0 2024-05-04T07:50:53.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe814045020 con 0x7fe8240b6140 2024-05-04T07:50:53.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f0c9b400640 1 -- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c0b4a00 msgr2=0x7f0c9c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f0c9b400640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f0c9b400640 1 -- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 msgr2=0x7f0c9c0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f0c9b400640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f0c9b400640 1 -- 172.21.15.136:0/3917434131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c0c9620 con 0x7f0c9c0b4000 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.784+0000 7f9f59400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:39170/0 (socket says 172.21.15.136:39170) 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 -- 172.21.15.136:0/1769909759 learned_addr learned my addr 172.21.15.136:0/1769909759 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f5a800640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5c15f8a0 0x7f9f5c0ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7fe81aa00640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 0x7fe8000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f0c9be00640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 -- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5c15f8a0 msgr2=0x7f9f5c0ba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5c15f8a0 0x7f9f5c0ba260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 -- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f5c0b6140 msgr2=0x7f9f5c2010c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f5c0b6140 0x7f9f5c2010c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7f9f59400640 1 -- 172.21.15.136:0/1769909759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c201600 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.785+0000 7fe81be00640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 0x7fe8000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7f9f59400640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009890 tx=0x7f9f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7fab44c00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 0x7fab280787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fab34096e80 con 0x7fab480d1e30 2024-05-04T07:50:53.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7f2bae000640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 0x7f2b98078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ba8096f90 con 0x7f2bb80d03d0 2024-05-04T07:50:53.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7fe81be00640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 0x7fe8000787c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8240d3f00 tx=0x7fe80c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.835 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.786+0000 7f0c9b400640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 0x7f0c9c201910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00c390 tx=0x7f0c8c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.787+0000 7f2bb5e00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 0x7f2b98078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.787+0000 7fab4d000640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 0x7fab280787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.787+0000 7f2bb5e00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 0x7f2b98078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bb81f8ce0 tx=0x7f2ba402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.787+0000 7fab4d000640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 0x7fab280787c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a400 tx=0x7fab4000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.789+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8140b5ec0 con 0x7fe8240b6140 2024-05-04T07:50:53.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.789+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48037050 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.790+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c0ba870 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.790+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c15ff90 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.790+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2ba8021020 con 0x7f2bb80d03d0 2024-05-04T07:50:53.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.791+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5c069470 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.794+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f48043070 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.794+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4803cad0 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.794+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe81404c020 con 0x7fe8240b6140 2024-05-04T07:50:53.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.797+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9f4803cc70 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.799+0000 7f9f52000640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 0x7f9f3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.799+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9f480b91e0 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.800+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9f480827f0 con 0x7f9f5c0d1a50 2024-05-04T07:50:53.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.800+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580a75b0 con 0x7feb50048040 2024-05-04T07:50:53.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.800+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c017070 con 0x7f0c9c0b4000 2024-05-04T07:50:53.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.801+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8dc8081770 con 0x7f8dcc00ab40 2024-05-04T07:50:53.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.801+0000 7f9f59e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 0x7f9f3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.801+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c0c9900 con 0x7f0c9c0b4000 2024-05-04T07:50:53.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.801+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c0c9ec0 con 0x7f0c9c0b4000 2024-05-04T07:50:53.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.800+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb580af880 con 0x7feb50048040 2024-05-04T07:50:53.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.800+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580afc70 con 0x7feb50048040 2024-05-04T07:50:53.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.802+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c005ce0 con 0x7f0c9c0b4000 2024-05-04T07:50:53.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.802+0000 7f9f59e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 0x7f9f3c078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001590 tx=0x7f9f4c007c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.802+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c0072d0 con 0x7f0c9c0b4000 2024-05-04T07:50:53.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.802+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5004da10 con 0x7feb50048040 2024-05-04T07:50:53.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.802+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb500da950 con 0x7feb50048040 2024-05-04T07:50:53.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.804+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c74005290 con 0x7f0c9c0b4000 2024-05-04T07:50:53.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.804+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb500089d0 con 0x7feb50048040 2024-05-04T07:50:53.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.808+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c8c01a070 con 0x7f0c9c0b4000 2024-05-04T07:50:53.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.809+0000 7f0c93400640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 0x7f0c7c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.809+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0c8c096fe0 con 0x7f0c9c0b4000 2024-05-04T07:50:53.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.809+0000 7f0c9aa00640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 0x7f0c7c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.809+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb5806e420 con 0x7feb50048040 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.810+0000 7feb4e000640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 0x7feb38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.810+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feb58133580 con 0x7feb50048040 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.811+0000 7feb55e00640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 0x7feb38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.812+0000 7feb55e00640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 0x7feb38078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb48009b60 tx=0x7feb48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.812+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fab3403a080 con 0x7fab480d1e30 2024-05-04T07:50:53.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.813+0000 7f0c9aa00640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 0x7f0c7c0787c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c88034000 tx=0x7f0c8802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:53.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.820+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb580bd030 con 0x7feb50048040 2024-05-04T07:50:53.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:53.832+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c8c05ff90 con 0x7f0c9c0b4000 2024-05-04T07:50:54.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.199+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa4b80cfcf0 con 0x7fa4b80b5340 2024-05-04T07:50:54.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.200+0000 7fa4afe00640 1 -- 172.21.15.136:0/1104820012 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa4a8060c00 con 0x7fa4b80b5340 2024-05-04T07:50:54.201 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:54.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.203+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 msgr2=0x7fa498078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.203+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 0x7fa498078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0005fd0 tx=0x7fa4b0007ed0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.204+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 msgr2=0x7fa4b80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.204+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800e9b0 tx=0x7fa4a800ee70 comp rx=0 tx=0).stop 2024-05-04T07:50:54.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 shutdown_connections 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa4980763a0 0x7fa498078860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4b80baaf0 0x7fa4b80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4b80c99c0 0x7fa4b80ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 --2- 172.21.15.136:0/1104820012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4b80b5340 0x7fa4b80ce910 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.205+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 >> 172.21.15.136:0/1104820012 conn(0x7fa4b80d4e60 msgr2=0x7fa4b80b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.206+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 shutdown_connections 2024-05-04T07:50:54.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.206+0000 7fa4bd800640 1 -- 172.21.15.136:0/1104820012 wait complete. 2024-05-04T07:50:54.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.225+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2bb814e420 con 0x7f2bb80d03d0 2024-05-04T07:50:54.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.226+0000 7f2bae000640 1 -- 172.21.15.136:0/2249331726 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ba805ff40 con 0x7f2bb80d03d0 2024-05-04T07:50:54.227 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:54.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.230+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 msgr2=0x7f2b98078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.230+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 0x7f2b98078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bb81f8ce0 tx=0x7f2ba402e000 comp rx=0 tx=0).stop 2024-05-04T07:50:54.231 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.230+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 msgr2=0x7f2bb806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 0x7f2bb806fd70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800c460 tx=0x7f2ba800c920 comp rx=0 tx=0).stop 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 shutdown_connections 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2b980763a0 0x7f2b98078860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bb815b680 0x7f2bb81436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bb80d03d0 0x7f2bb806fd70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 --2- 172.21.15.136:0/2249331726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bb806c3a0 0x7f2bb814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 >> 172.21.15.136:0/2249331726 conn(0x7f2bb80cdf60 msgr2=0x7f2bb80cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 shutdown_connections 2024-05-04T07:50:54.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.231+0000 7f2bbce00640 1 -- 172.21.15.136:0/2249331726 wait complete. 2024-05-04T07:50:54.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-05-04T07:50:54.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.250+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe8240d3b70 con 0x7fe8240b6140 2024-05-04T07:50:54.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.251+0000 7fe81aa00640 1 -- 172.21.15.136:0/434651454 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8140811e0 con 0x7fe8240b6140 2024-05-04T07:50:54.252 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:54.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.254+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0c74005850 con 0x7f0c9c0b4000 2024-05-04T07:50:54.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.254+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 msgr2=0x7fe8000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.254+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 0x7fe8000787c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8240d3f00 tx=0x7fe80c008040 comp rx=0 tx=0).stop 2024-05-04T07:50:54.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.254+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 msgr2=0x7fe824152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.254+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe814009890 tx=0x7fe8140046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9f5c0cfc70 con 0x7f9f5c0d1a50 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 shutdown_connections 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe800076300 0x7fe8000787c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8240d1e30 0x7fe8240ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe8240d1a50 0x7fe8240ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 --2- 172.21.15.136:0/434651454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8240b6140 0x7fe824152660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 >> 172.21.15.136:0/434651454 conn(0x7fe8240d5080 msgr2=0x7fe82406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 shutdown_connections 2024-05-04T07:50:54.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8dcc0578f0 con 0x7f8dcc00ab40 2024-05-04T07:50:54.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7f0c93400640 1 -- 172.21.15.136:0/3917434131 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c8c064290 con 0x7f0c9c0b4000 2024-05-04T07:50:54.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.255+0000 7fe829400640 1 -- 172.21.15.136:0/434651454 wait complete. 2024-05-04T07:50:54.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.256+0000 7f9f52000640 1 -- 172.21.15.136:0/1769909759 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f480820f0 con 0x7f9f5c0d1a50 2024-05-04T07:50:54.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-05-04T07:50:54.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.256+0000 7f8dc7e00640 1 -- 172.21.15.136:0/1600188575 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8dcc0578f0 con 0x7f8dcc00ab40 2024-05-04T07:50:54.260 INFO:teuthology.orchestra.run.smithi136.stdout:55834574856 2024-05-04T07:50:54.261 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:54.261 INFO:teuthology.orchestra.run.smithi136.stdout:55834574856 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 msgr2=0x7f0c7c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 0x7f0c7c0787c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0c88034000 tx=0x7f0c8802c000 comp rx=0 tx=0).stop 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 msgr2=0x7f0c9c201910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 0x7f0c9c201910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00c390 tx=0x7f0c8c00c850 comp rx=0 tx=0).stop 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 shutdown_connections 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c7c076300 0x7f0c7c0787c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c9c1629c0 0x7f0c9c0cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c0b4a00 0x7f0c9c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 --2- 172.21.15.136:0/3917434131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0b4000 0x7f0c9c201910 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00c390 tx=0x7f0c8c00c850 comp rx=0 tx=0).stop 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.259+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 >> 172.21.15.136:0/3917434131 conn(0x7f0c9c09e3f0 msgr2=0x7f0c9c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 shutdown_connections 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f0ca2200640 1 -- 172.21.15.136:0/3917434131 wait complete. 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 msgr2=0x7f9f3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 0x7f9f3c078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001590 tx=0x7f9f4c007c90 comp rx=0 tx=0).stop 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 msgr2=0x7f9f5c0b9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009890 tx=0x7f9f480046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 shutdown_connections 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f3c0762d0 0x7f9f3c078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f5c15f8a0 0x7f9f5c0ba260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f5c0d1a50 0x7f9f5c0b9d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f9f60e00640 1 --2- 172.21.15.136:0/1769909759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f5c0b6140 0x7f9f5c2010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 >> 172.21.15.136:0/1769909759 conn(0x7f9f5c0d5080 msgr2=0x7f9f5c0c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 msgr2=0x7f8db4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 0x7f8db4078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0510b0 tx=0x7f8dc0008040 comp rx=0 tx=0).stop 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 msgr2=0x7f8dcc0da330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.260+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009870 tx=0x7f8dc80046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 shutdown_connections 2024-05-04T07:50:54.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f9f60e00640 1 -- 172.21.15.136:0/1769909759 wait complete. 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 shutdown_connections 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8db40762d0 0x7f8db4078790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dcc0e1310 0x7f8dcc0378f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dcc0516e0 0x7f8dcc0e4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 --2- 172.21.15.136:0/1600188575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8dcc00ab40 0x7f8dcc0da330 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.261+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 >> 172.21.15.136:0/1600188575 conn(0x7f8dcc056cd0 msgr2=0x7f8dcc03b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.262+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 shutdown_connections 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.262+0000 7f8dd9400640 1 -- 172.21.15.136:0/1600188575 wait complete. 2024-05-04T07:50:54.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.263+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb50005390 con 0x7feb50048040 2024-05-04T07:50:54.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.264+0000 7feb4e000640 1 -- 172.21.15.136:0/1769370498 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb580fcb80 con 0x7feb50048040 2024-05-04T07:50:54.267 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:54.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 msgr2=0x7feb38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fab20005850 con 0x7fab480d1e30 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 0x7feb38078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb48009b60 tx=0x7feb48008040 comp rx=0 tx=0).stop 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 msgr2=0x7feb5017c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 0x7feb5017c9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb580520f0 tx=0x7feb5806b0b0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 shutdown_connections 2024-05-04T07:50:54.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb380762d0 0x7feb38078790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb50048040 0x7feb5017c9e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb50038720 0x7feb500dcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 --2- 172.21.15.136:0/1769370498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb50037bb0 0x7feb5004cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.268+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 >> 172.21.15.136:0/1769370498 conn(0x7feb50009fb0 msgr2=0x7feb500e6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.269+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 shutdown_connections 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.269+0000 7feb57200640 1 -- 172.21.15.136:0/1769370498 wait complete. 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.269+0000 7fab44c00640 1 -- 172.21.15.136:0/2091266149 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab3405fe70 con 0x7fab480d1e30 2024-05-04T07:50:54.270 INFO:teuthology.orchestra.run.smithi136.stdout:55834574857 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 msgr2=0x7fab280787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 0x7fab280787c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab4000a400 tx=0x7fab4000d040 comp rx=0 tx=0).stop 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 msgr2=0x7fab480b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 0x7fab480b8b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fab3400c3c0 tx=0x7fab3400c880 comp rx=0 tx=0).stop 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 shutdown_connections 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fab28076300 0x7fab280787c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab480d1e30 0x7fab480b8b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab480d1a50 0x7fab480b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 --2- 172.21.15.136:0/2091266149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab480b6140 0x7fab480ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:54.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 >> 172.21.15.136:0/2091266149 conn(0x7fab480d5080 msgr2=0x7fab480b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:54.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 shutdown_connections 2024-05-04T07:50:54.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:54.273+0000 7fab4fa00640 1 -- 172.21.15.136:0/2091266149 wait complete. 2024-05-04T07:50:54.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-05-04T07:50:54.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-05-04T07:50:54.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-05-04T07:50:54.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-05-04T07:50:54.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-05-04T07:50:54.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-05-04T07:50:55.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T07:50:55.261 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T07:50:55.285 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T07:50:55.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T07:50:55.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T07:50:55.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T07:50:55.295 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T07:50:55.297 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T07:50:55.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.515+0000 7eff66e00640 1 Processor -- start 2024-05-04T07:50:55.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.516+0000 7eff66e00640 1 -- start start 2024-05-04T07:50:55.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.518+0000 7eff66e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff580e30b0 0x7eff58057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.518+0000 7eff66e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.518+0000 7eff66e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff580582c0 con 0x7eff5803e830 2024-05-04T07:50:55.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.518+0000 7eff66e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7eff58058560 con 0x7eff580e30b0 2024-05-04T07:50:55.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.518+0000 7eff66e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7eff58058840 con 0x7eff580542f0 2024-05-04T07:50:55.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.519+0000 7eff64e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.519+0000 7eff64e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580068c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:33716/0 (socket says 172.21.15.136:33716) 2024-05-04T07:50:55.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.519+0000 7eff5fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff580e30b0 0x7eff58057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.520+0000 7eff5fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff580e30b0 0x7eff58057d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58888/0 (socket says 172.21.15.136:58888) 2024-05-04T07:50:55.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.520+0000 7eff5fe00640 1 -- 172.21.15.136:0/795081080 learned_addr learned my addr 172.21.15.136:0/795081080 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.521+0000 7eff5fe00640 1 -- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 msgr2=0x7eff580068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.521+0000 7eff5fe00640 1 --2- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.521+0000 7eff5fe00640 1 -- 172.21.15.136:0/795081080 >> v1:172.21.15.136:6789/0 conn(0x7eff5803e830 legacy=0x7eff58053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.522+0000 7eff5fe00640 1 -- 172.21.15.136:0/795081080 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff58058b20 con 0x7eff580e30b0 2024-05-04T07:50:55.524 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.524+0000 7eff5fe00640 1 --2- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff580e30b0 0x7eff58057d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009870 tx=0x7eff4c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97775cb7dcf55c19 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.525+0000 7eff5ea00640 1 -- 172.21.15.136:0/795081080 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c037070 con 0x7eff580e30b0 2024-05-04T07:50:55.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.525+0000 7eff5ea00640 1 -- 172.21.15.136:0/795081080 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c032440 con 0x7eff580e30b0 2024-05-04T07:50:55.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.525+0000 7eff5ea00640 1 -- 172.21.15.136:0/795081080 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c032810 con 0x7eff580e30b0 2024-05-04T07:50:55.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.526+0000 7eff66e00640 1 -- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff580e30b0 msgr2=0x7eff58057d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.526+0000 7eff66e00640 1 --2- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff580e30b0 0x7eff58057d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009870 tx=0x7eff4c02a250 comp rx=0 tx=0).stop 2024-05-04T07:50:55.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.527+0000 7eff66e00640 1 -- 172.21.15.136:0/795081080 shutdown_connections 2024-05-04T07:50:55.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.527+0000 7eff66e00640 1 --2- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.527+0000 7eff66e00640 1 --2- 172.21.15.136:0/795081080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff580e30b0 0x7eff58057d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.527+0000 7eff66e00640 1 -- 172.21.15.136:0/795081080 >> 172.21.15.136:0/795081080 conn(0x7eff580559d0 msgr2=0x7eff58055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.528+0000 7eff66e00640 1 -- 172.21.15.136:0/795081080 shutdown_connections 2024-05-04T07:50:55.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.528+0000 7eff66e00640 1 -- 172.21.15.136:0/795081080 wait complete. 2024-05-04T07:50:55.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.531+0000 7eff66e00640 1 Processor -- start 2024-05-04T07:50:55.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.532+0000 7eff66e00640 1 -- start start 2024-05-04T07:50:55.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.534+0000 7eff66e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.534+0000 7eff66e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.535+0000 7eff66e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 0x7eff58055db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.535+0000 7eff66e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff580e3490 con 0x7eff580e30b0 2024-05-04T07:50:55.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.535+0000 7eff66e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff5803bfb0 con 0x7eff5803e830 2024-05-04T07:50:55.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.535+0000 7eff66e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7eff58006e00 con 0x7eff580542f0 2024-05-04T07:50:55.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.536+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.536+0000 7eff5f400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.536+0000 7eff5fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58894/0 (socket says 172.21.15.136:58894) 2024-05-04T07:50:55.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.536+0000 7eff5fe00640 1 -- 172.21.15.136:0/2819466610 learned_addr learned my addr 172.21.15.136:0/2819466610 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.536+0000 7eff64e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 0x7eff58055db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff5fe00640 1 -- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 msgr2=0x7eff580e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff5fe00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff5fe00640 1 -- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 msgr2=0x7eff58055db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff5fe00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 0x7eff58055db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff5fe00640 1 -- 172.21.15.136:0/2819466610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff580c7c20 con 0x7eff5803e830 2024-05-04T07:50:55.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.538+0000 7eff64e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 0x7eff58055db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:55.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.539+0000 7eff5fe00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009870 tx=0x7eff4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.540+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c041020 con 0x7eff5803e830 2024-05-04T07:50:55.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.540+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4c030640 con 0x7eff5803e830 2024-05-04T07:50:55.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.540+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c037040 con 0x7eff5803e830 2024-05-04T07:50:55.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.541+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff580c7ec0 con 0x7eff5803e830 2024-05-04T07:50:55.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.541+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff580c8480 con 0x7eff5803e830 2024-05-04T07:50:55.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.543+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff580057d0 con 0x7eff5803e830 2024-05-04T07:50:55.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.546+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff4c044020 con 0x7eff5803e830 2024-05-04T07:50:55.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.547+0000 7eff53e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 0x7eff400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.548+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff4c07dcf0 con 0x7eff5803e830 2024-05-04T07:50:55.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.549+0000 7eff5f400640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 0x7eff400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.551+0000 7eff5f400640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 0x7eff400787c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff580e3ca0 tx=0x7eff54009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.560+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff4c04b030 con 0x7eff5803e830 2024-05-04T07:50:55.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.574+0000 7f12c3200640 1 Processor -- start 2024-05-04T07:50:55.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.574+0000 7fc0d8600640 1 Processor -- start 2024-05-04T07:50:55.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.574+0000 7f12c3200640 1 -- start start 2024-05-04T07:50:55.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.575+0000 7fc0d8600640 1 -- start start 2024-05-04T07:50:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7fc0d8600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7f12c3200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f12bc0b4a00 0x7f12bc0d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7f12c3200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12bc0d2280 con 0x7f12bc1629c0 2024-05-04T07:50:55.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7f12c3200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12bc0d2560 con 0x7f12bc0b4000 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7f12c3200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f12bc0d2840 con 0x7f12bc0b4a00 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7fc0d8600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6140 0x7fc0d015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7fc0d8600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d00d07d0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7fc0d8600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d00d0ab0 con 0x7fc0d00b6140 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.577+0000 7fc0d8600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d00d0d90 con 0x7fc0d00d1a50 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7f12bbe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f12bc1629c0 0x7f12bc0d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38890/0 (socket says 172.21.15.136:38890) 2024-05-04T07:50:55.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7f12bbe00640 1 -- 172.21.15.136:0/224638358 learned_addr learned my addr 172.21.15.136:0/224638358 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7fc0d5c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7fc0d6600640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc0d00d1e30 0x7fc0d00d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:43982/0 (socket says 172.21.15.136:43982) 2024-05-04T07:50:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7fc0d6600640 1 -- 172.21.15.136:0/807840295 learned_addr learned my addr 172.21.15.136:0/807840295 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7f12bb400640 1 --2- 172.21.15.136:0/224638358 >> v2:172.21.15.136:3300/0 conn(0x7f12bc0b4a00 0x7f12bc0d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7efc71e00640 1 Processor -- start 2024-05-04T07:50:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.578+0000 7fc0d5200640 1 --2- 172.21.15.136:0/807840295 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6140 0x7fc0d015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0cfe00640 1 -- 172.21.15.136:0/807840295 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371498294 0 0) 0x7fc0d00d07d0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0cfe00640 1 -- 172.21.15.136:0/807840295 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b8003520 con 0x7fc0d00d1e30 2024-05-04T07:50:55.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7efc71e00640 1 -- start start 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.580+0000 7f12bb400640 1 -- 172.21.15.136:0/224638358 >> v1:172.21.15.142:6789/0 conn(0x7f12bc0b4000 legacy=0x7f12bc0d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.580+0000 7f12bb400640 1 -- 172.21.15.136:0/224638358 >> v1:172.21.15.136:6789/0 conn(0x7f12bc1629c0 legacy=0x7f12bc0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.580+0000 7f12bb400640 1 -- 172.21.15.136:0/224638358 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc0cff10 con 0x7f12bc0b4a00 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc71e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 0x7efc6c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc71e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 0x7efc6c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc71e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6c0d07d0 con 0x7efc6c0d1a50 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc71e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efc6c0d0ab0 con 0x7efc6c15f8a0 2024-05-04T07:50:55.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc71e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c0d0d90 con 0x7efc6c0b6140 2024-05-04T07:50:55.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0d5c00640 1 -- 172.21.15.136:0/807840295 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6140 msgr2=0x7fc0d015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0d5c00640 1 --2- 172.21.15.136:0/807840295 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6140 0x7fc0d015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0d5c00640 1 -- 172.21.15.136:0/807840295 >> v1:172.21.15.142:6789/0 conn(0x7fc0d00d1e30 legacy=0x7fc0d00d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.579+0000 7fc0d5c00640 1 -- 172.21.15.136:0/807840295 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d00d5eb0 con 0x7fc0d00d1a50 2024-05-04T07:50:55.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7f12bb400640 1 --2- 172.21.15.136:0/224638358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0d33d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097a0 tx=0x7f12a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12a20034491ce6e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc6aa00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7efc6c0d1a50 0x7efc6c15f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38906/0 (socket says 172.21.15.136:38906) 2024-05-04T07:50:55.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc6aa00640 1 -- 172.21.15.136:0/2725255101 learned_addr learned my addr 172.21.15.136:0/2725255101 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7efc6a000640 1 --2- 172.21.15.136:0/2725255101 >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 0x7efc6c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7efc6b400640 1 --2- 172.21.15.136:0/2725255101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 0x7efc6c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.583 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7f12baa00640 1 -- 172.21.15.136:0/224638358 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8037070 con 0x7f12bc0b4a00 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563284096 0 0) 0x7efc6c0d07d0 con 0x7efc6c0d1a50 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc50003520 con 0x7efc6c0d1a50 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc6b400640 1 -- 172.21.15.136:0/2725255101 >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 msgr2=0x7efc6c0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc6b400640 1 --2- 172.21.15.136:0/2725255101 >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 0x7efc6c0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc6b400640 1 -- 172.21.15.136:0/2725255101 >> v1:172.21.15.136:6789/0 conn(0x7efc6c0d1a50 legacy=0x7efc6c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1745520607 0 0) 0x7efc50003520 con 0x7efc6c0d1a50 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc6b400640 1 -- 172.21.15.136:0/2725255101 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c0d5eb0 con 0x7efc6c0b6140 2024-05-04T07:50:55.584 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7efc6a000640 1 --2- 172.21.15.136:0/2725255101 >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 0x7efc6c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7f12baa00640 1 -- 172.21.15.136:0/224638358 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a8032440 con 0x7f12bc0b4a00 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7f12baa00640 1 -- 172.21.15.136:0/224638358 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8032810 con 0x7f12bc0b4a00 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.581+0000 7fc0d5c00640 1 --2- 172.21.15.136:0/807840295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d015f190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00097a0 tx=0x7fc0c002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4a5c6062c43a9ef server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7fc0cfe00640 1 -- 172.21.15.136:0/807840295 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0037070 con 0x7fc0d00d1a50 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7fc0cfe00640 1 -- 172.21.15.136:0/807840295 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c0032440 con 0x7fc0d00d1a50 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.582+0000 7fc0cfe00640 1 -- 172.21.15.136:0/807840295 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0032850 con 0x7fc0d00d1a50 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7fc0d8600640 1 -- 172.21.15.136:0/807840295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 msgr2=0x7fc0d015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.583+0000 7fc0d8600640 1 --2- 172.21.15.136:0/807840295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d015f190 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00097a0 tx=0x7fc0c002a1a0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7fc0d8600640 1 -- 172.21.15.136:0/807840295 shutdown_connections 2024-05-04T07:50:55.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7fc0d8600640 1 --2- 172.21.15.136:0/807840295 >> v2:172.21.15.142:3300/0 conn(0x7fc0d00b6140 0x7fc0d015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7fc0d8600640 1 --2- 172.21.15.136:0/807840295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d015f190 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7fc0d8600640 1 -- 172.21.15.136:0/807840295 >> 172.21.15.136:0/807840295 conn(0x7fc0d00d5080 msgr2=0x7fc0d00d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7f12c3200640 1 -- 172.21.15.136:0/224638358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4a00 msgr2=0x7f12bc0d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.584+0000 7efc6b400640 1 --2- 172.21.15.136:0/2725255101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 0x7efc6c0c91f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc640097a0 tx=0x7efc6402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a186a98099bfaf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.586 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7fc0d8600640 1 -- 172.21.15.136:0/807840295 shutdown_connections 2024-05-04T07:50:55.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7f12c3200640 1 --2- 172.21.15.136:0/224638358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0d33d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12a80097a0 tx=0x7f12a802a230 comp rx=0 tx=0).stop 2024-05-04T07:50:55.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7fc0d8600640 1 -- 172.21.15.136:0/807840295 wait complete. 2024-05-04T07:50:55.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64037070 con 0x7efc6c0b6140 2024-05-04T07:50:55.587 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6402aba0 con 0x7efc6c0b6140 2024-05-04T07:50:55.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7fd1d8e00640 1 Processor -- start 2024-05-04T07:50:55.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7efc69600640 1 -- 172.21.15.136:0/2725255101 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc580016d0 con 0x7efc6c0b6140 2024-05-04T07:50:55.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7f12c3200640 1 -- 172.21.15.136:0/224638358 shutdown_connections 2024-05-04T07:50:55.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7f12c3200640 1 --2- 172.21.15.136:0/224638358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0d33d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.588 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7f12c3200640 1 -- 172.21.15.136:0/224638358 >> 172.21.15.136:0/224638358 conn(0x7f12bc09e3f0 msgr2=0x7f12bc0d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.585+0000 7fd1d8e00640 1 -- start start 2024-05-04T07:50:55.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.586+0000 7f12c3200640 1 -- 172.21.15.136:0/224638358 shutdown_connections 2024-05-04T07:50:55.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.586+0000 7f12c3200640 1 -- 172.21.15.136:0/224638358 wait complete. 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.586+0000 7efc71e00640 1 -- 172.21.15.136:0/2725255101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 msgr2=0x7efc6c0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.586+0000 7efc71e00640 1 --2- 172.21.15.136:0/2725255101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 0x7efc6c0c91f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc640097a0 tx=0x7efc6402a110 comp rx=0 tx=0).stop 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 -- 172.21.15.136:0/2725255101 shutdown_connections 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 --2- 172.21.15.136:0/2725255101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c0b6140 0x7efc6c0c91f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 --2- 172.21.15.136:0/2725255101 >> v2:172.21.15.142:3300/0 conn(0x7efc6c15f8a0 0x7efc6c0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 -- 172.21.15.136:0/2725255101 >> 172.21.15.136:0/2725255101 conn(0x7efc6c0d5080 msgr2=0x7efc6c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 -- 172.21.15.136:0/2725255101 shutdown_connections 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7efc71e00640 1 -- 172.21.15.136:0/2725255101 wait complete. 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7fd1d8e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd1d40cc080 0x7fd1d40ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7fd1d8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 0x7fd1d4072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7fd1d8e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d40ce820 con 0x7fd1d415b320 2024-05-04T07:50:55.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.587+0000 7fd1d8e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d4073290 con 0x7fd1d40cc080 2024-05-04T07:50:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.588+0000 7fc0d8600640 1 Processor -- start 2024-05-04T07:50:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.588+0000 7fc0d8600640 1 -- start start 2024-05-04T07:50:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7f12c3200640 1 Processor -- start 2024-05-04T07:50:55.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7f12c3200640 1 -- start start 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.588+0000 7fd1d8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d40cd420 con 0x7fd1d40728e0 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7fd1d1e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd1d415b320 0x7fd1d40cfb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38918/0 (socket says 172.21.15.136:38918) 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7fd1d2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 0x7fd1d4072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7fd1d2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 0x7fd1d4072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:33770/0 (socket says 172.21.15.136:33770) 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7fd1d2800640 1 -- 172.21.15.136:0/3627914967 learned_addr learned my addr 172.21.15.136:0/3627914967 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.589+0000 7fd1d1400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd1d40cc080 0x7fd1d40ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0d00b6140 0x7fc0d00ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d01f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d00b6810 con 0x7fc0d00b6140 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d00b6690 con 0x7fc0d00d1e30 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7fc0d8600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d00c9cc0 con 0x7fc0d00d1a50 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.590+0000 7efc71e00640 1 Processor -- start 2024-05-04T07:50:55.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fd1d0a00640 1 -- 172.21.15.136:0/3627914967 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043109438 0 0) 0x7fd1d40ce820 con 0x7fd1d415b320 2024-05-04T07:50:55.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7f1a52c00640 1 Processor -- start 2024-05-04T07:50:55.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fc0d6600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.595 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fd1d0a00640 1 -- 172.21.15.136:0/3627914967 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003520 con 0x7fd1d415b320 2024-05-04T07:50:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fc0d6600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58920/0 (socket says 172.21.15.136:58920) 2024-05-04T07:50:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fc0d6600640 1 -- 172.21.15.136:0/1256616787 learned_addr learned my addr 172.21.15.136:0/1256616787 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fc0d5c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0d00b6140 0x7fc0d00ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7fc0d5200640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d01f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.591+0000 7efc71e00640 1 -- start start 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fd1d1400640 1 -- 172.21.15.136:0/3627914967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 msgr2=0x7fd1d4072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fd1d1400640 1 --2- 172.21.15.136:0/3627914967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 0x7fd1d4072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fd1d1400640 1 -- 172.21.15.136:0/3627914967 >> v1:172.21.15.136:6789/0 conn(0x7fd1d415b320 legacy=0x7fd1d40cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fd1d1400640 1 -- 172.21.15.136:0/3627914967 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d40ceac0 con 0x7fd1d40cc080 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fc0d6600640 1 -- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 msgr2=0x7fc0d01f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fc0d6600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d01f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fc0d6600640 1 -- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0d00b6140 msgr2=0x7fc0d00ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fc0d6600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0d00b6140 0x7fc0d00ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7fc0d6600640 1 -- 172.21.15.136:0/1256616787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d014eba0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f0fb3e00640 1 Processor -- start 2024-05-04T07:50:55.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4000 0x7f12bc15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc1629c0 0x7f12bc0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc162f20 con 0x7f12bc0b4000 2024-05-04T07:50:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc162da0 con 0x7f12bc0b4a00 2024-05-04T07:50:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7efc71e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 0x7efc6c1fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7fc0d6600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800caa0 tx=0x7fc0c800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7f0fb3e00640 1 -- start start 2024-05-04T07:50:55.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7efc71e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc6c0d1a50 0x7efc6c06e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7efc71e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.600 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f1a52c00640 1 -- start start 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800ac00 con 0x7fc0d00d1e30 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c800ada0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8012600 con 0x7fc0d00d1e30 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.592+0000 7f12c3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f12bc0d3910 con 0x7f12bc1629c0 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7f12bb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7f12bb400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58936/0 (socket says 172.21.15.136:58936) 2024-05-04T07:50:55.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.593+0000 7f12bb400640 1 -- 172.21.15.136:0/254150185 learned_addr learned my addr 172.21.15.136:0/254150185 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 0x7efc6c1fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc71e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c0b6810 con 0x7efc6c0d1a50 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc71e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c0b6690 con 0x7efc6c0b6140 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc71e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c0d1e30 con 0x7efc6c15f8a0 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d014ee20 con 0x7fc0d00d1e30 2024-05-04T07:50:55.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d014f3e0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f1a52c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1a4c15f8a0 0x7f1a4c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f1a52c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0d07d0 con 0x7f1a4c0b6140 2024-05-04T07:50:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f1a52c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0d0ab0 con 0x7f1a4c0d1a50 2024-05-04T07:50:55.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f1a52c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4c0d0d90 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6aa00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 0x7efc6c1fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58948/0 (socket says 172.21.15.136:58948) 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6b400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:33794/0 (socket says 172.21.15.136:33794) 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6b400640 1 -- 172.21.15.136:0/3505426750 learned_addr learned my addr 172.21.15.136:0/3505426750 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f12bb400640 1 -- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc1629c0 msgr2=0x7f12bc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f12bb400640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc1629c0 0x7f12bc0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f12bb400640 1 -- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4000 msgr2=0x7f12bc15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f12bb400640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4000 0x7f12bc15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7f12bb400640 1 -- 172.21.15.136:0/254150185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc15dc30 con 0x7f12bc0b4a00 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7efc6a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc6c0d1a50 0x7efc6c06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.594+0000 7fd1d1400640 1 --2- 172.21.15.136:0/3627914967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d40cc080 0x7fd1d40ccee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097a0 tx=0x7fd1c402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7317a59fde987e8d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a50c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1a4c0b6140 0x7f1a4c0c91f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38932/0 (socket says 172.21.15.136:38932) 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a50c00640 1 -- 172.21.15.136:0/3128016121 learned_addr learned my addr 172.21.15.136:0/3128016121 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a4be00640 1 --1- 172.21.15.136:0/3128016121 >> v1:172.21.15.142:6789/0 conn(0x7f1a4c0d1a50 0x7f1a4c15f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:43992/0 (socket says 172.21.15.136:43992) 2024-05-04T07:50:55.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a4b400640 1 --2- 172.21.15.136:0/3128016121 >> v2:172.21.15.136:3300/0 conn(0x7f1a4c15f8a0 0x7f1a4c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7fb4dee00640 1 Processor -- start 2024-05-04T07:50:55.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f12bb400640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098c0 tx=0x7f12a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d014faa0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f0fb3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fac0ce820 0x7f0fac0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a4b400640 1 -- 172.21.15.136:0/3128016121 >> v1:172.21.15.142:6789/0 conn(0x7f1a4c0d1a50 legacy=0x7f1a4c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a4b400640 1 -- 172.21.15.136:0/3128016121 >> v1:172.21.15.136:6789/0 conn(0x7f1a4c0b6140 legacy=0x7f1a4c0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f1a4b400640 1 -- 172.21.15.136:0/3128016121 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c0d5eb0 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f0fb3e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fac0ced70 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7efc6b400640 1 -- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 msgr2=0x7efc6c1fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7efc6b400640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 0x7efc6c1fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7efc6b400640 1 -- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc6c0d1a50 msgr2=0x7efc6c06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7efc6b400640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc6c0d1a50 0x7efc6c06e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7efc6b400640 1 -- 172.21.15.136:0/3505426750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c1588e0 con 0x7efc6c15f8a0 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f0fb3e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fac0cf050 con 0x7f0fac071ed0 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7f0fb3e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0fac0c45c0 con 0x7f0fac0ce820 2024-05-04T07:50:55.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f0fb1400640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0fac071ed0 0x7f0fac0722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:44008/0 (socket says 172.21.15.136:44008) 2024-05-04T07:50:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f0fb1400640 1 -- 172.21.15.136:0/3542229840 learned_addr learned my addr 172.21.15.136:0/3542229840 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7fd1d0a00640 1 -- 172.21.15.136:0/3627914967 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4037070 con 0x7fd1d40cc080 2024-05-04T07:50:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7fd1d0a00640 1 -- 172.21.15.136:0/3627914967 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c402adb0 con 0x7fd1d40cc080 2024-05-04T07:50:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7fd1d0a00640 1 -- 172.21.15.136:0/3627914967 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4032660 con 0x7fd1d40cc080 2024-05-04T07:50:55.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.595+0000 7fb4dee00640 1 -- start start 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8037040 con 0x7f12bc0b4a00 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a8042070 con 0x7f12bc0b4a00 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8030cc0 con 0x7f12bc0b4a00 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc0ca6e0 con 0x7f12bc0b4a00 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7efc6b400640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc6402a700 tx=0x7efc640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/3542229840 >> v2:172.21.15.142:3300/0 conn(0x7f0fac0ce820 0x7f0fac0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fb4dee00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4d8071ed0 0x7fb4d80cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fb4dee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4d80ce820 0x7fb4d80722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fb4dee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d80727f0 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fb4dee00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d80c45c0 con 0x7fb4d8071ed0 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fb4dee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d80ced70 con 0x7fb4d80ce820 2024-05-04T07:50:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc0caca0 con 0x7f12bc0b4a00 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fd1d8e00640 1 -- 172.21.15.136:0/3627914967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d40cc080 msgr2=0x7fd1d40ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/3627914967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d40cc080 0x7fd1d40ccee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097a0 tx=0x7fd1c402a060 comp rx=0 tx=0).stop 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7f1a4b400640 1 --2- 172.21.15.136:0/3128016121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c15f8a0 0x7f1a4c0c8cb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0d60e0 tx=0x7f1a3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822f8347f1ebda3f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.596+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956753508 0 0) 0x7f0fac0cf050 con 0x7f0fac071ed0 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f94003520 con 0x7f0fac071ed0 2024-05-04T07:50:55.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463159756 0 0) 0x7f0fac0ced70 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.597+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fac0cf050 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64037070 con 0x7efc6c15f8a0 2024-05-04T07:50:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f1a4aa00640 1 -- 172.21.15.136:0/3128016121 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38037070 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f1a4aa00640 1 -- 172.21.15.136:0/3128016121 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a38032440 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.616 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fb4d7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb4d8071ed0 0x7fb4d80cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c158bc0 con 0x7efc6c15f8a0 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c154930 con 0x7efc6c15f8a0 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fd1d8e00640 1 -- 172.21.15.136:0/3627914967 shutdown_connections 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/3627914967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40728e0 0x7fd1d4072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/3627914967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d40cc080 0x7fd1d40ccee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.617 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fd1d8e00640 1 -- 172.21.15.136:0/3627914967 >> 172.21.15.136:0/3627914967 conn(0x7fd1d40d0c50 msgr2=0x7fd1d40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fb4dce00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb4d80cb7b0 0x7fb4d806dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38940/0 (socket says 172.21.15.136:38940) 2024-05-04T07:50:55.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7fb4dce00640 1 -- 172.21.15.136:0/3928160317 learned_addr learned my addr 172.21.15.136:0/3928160317 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:50:55.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f1a4aa00640 1 -- 172.21.15.136:0/3128016121 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38037070 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7fd1d8e00640 1 -- 172.21.15.136:0/3627914967 shutdown_connections 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900636712 0 0) 0x7f0fac0cf050 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 >> v2:172.21.15.142:3300/0 conn(0x7f0fac0ce820 msgr2=0x7f0fac0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 --2- 172.21.15.136:0/3542229840 >> v2:172.21.15.142:3300/0 conn(0x7f0fac0ce820 0x7f0fac0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 >> v1:172.21.15.142:6789/0 conn(0x7f0fac071ed0 legacy=0x7f0fac0722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac0cf330 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f0fa4001a50 con 0x7f0fac0cb7b0 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 >> v1:172.21.15.136:6789/0 conn(0x7f0fac0cb7b0 legacy=0x7f0fac06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 0x7f0f94004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94004800 0x7f0f94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f940053a0 0x7f0f9400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.619 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0c45c0 con 0x7f0f94003c60 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9400c2e0 con 0x7f0f940053a0 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0f9400c4e0 con 0x7f0f94004800 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/3542229840 >> v2:172.21.15.142:3300/0 conn(0x7f0fac0ce820 0x7f0fac0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7f0fb1400640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 0x7f0f94004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7f1a52c00640 1 -- 172.21.15.136:0/3128016121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c15f8a0 msgr2=0x7f1a4c0c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3128016121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c15f8a0 0x7f1a4c0c8cb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0d60e0 tx=0x7f1a3802a1a0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.620 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc069b10 con 0x7f12bc0b4a00 2024-05-04T07:50:55.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4d80ce820 0x7fb4d80722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64038040 con 0x7efc6c15f8a0 2024-05-04T07:50:55.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.598+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64004470 con 0x7efc6c15f8a0 2024-05-04T07:50:55.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570601718 0 0) 0x7fb4d80727f0 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4bc003520 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.599+0000 7fd1d8e00640 1 -- 172.21.15.136:0/3627914967 wait complete. 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f1a52c00640 1 -- 172.21.15.136:0/3128016121 shutdown_connections 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3128016121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c15f8a0 0x7f1a4c0c8cb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f1a52c00640 1 -- 172.21.15.136:0/3128016121 >> 172.21.15.136:0/3128016121 conn(0x7f1a4c0d5080 msgr2=0x7f1a4c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94004800 0x7f0f94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.622 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1e00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f940053a0 0x7f0f9400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756718540 0 0) 0x7fb4bc003520 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4d80ce820 msgr2=0x7fb4d80722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4d80ce820 0x7fb4d80722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 >> v2:172.21.15.142:3300/0 conn(0x7fb4d8071ed0 msgr2=0x7fb4d80cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 --2- 172.21.15.136:0/3928160317 >> v2:172.21.15.142:3300/0 conn(0x7fb4d8071ed0 0x7fb4d80cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d80cf050 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fb4d0001a70 con 0x7fb4d80cb7b0 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 >> v1:172.21.15.136:6789/0 conn(0x7fb4d80cb7b0 legacy=0x7fb4d806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f1a52c00640 1 -- 172.21.15.136:0/3128016121 shutdown_connections 2024-05-04T07:50:55.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc44005290 con 0x7efc6c15f8a0 2024-05-04T07:50:55.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc003a00 0x7fb4bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4bc004800 0x7fb4bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0051c0 0x7fb4bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80c45c0 con 0x7fb4bc004800 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80ced70 con 0x7fb4bc0051c0 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb4bc00bf00 con 0x7fb4bc003a00 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4bc004800 0x7fb4bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fd1d8e00640 1 Processor -- start 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4dce00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0051c0 0x7fb4bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 -- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc003a00 msgr2=0x7fb4bc003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc003a00 0x7fb4bc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 -- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0051c0 msgr2=0x7fb4bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0051c0 0x7fb4bc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fb4d7400640 1 -- 172.21.15.136:0/3928160317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d80cf050 con 0x7fb4bc004800 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1400640 1 -- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94004800 msgr2=0x7f0f94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1400640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f94004800 0x7f0f94004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1400640 1 -- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f940053a0 msgr2=0x7f0f9400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1400640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f940053a0 0x7f0f9400ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1400640 1 -- 172.21.15.136:0/3542229840 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac0cf050 con 0x7f0f94003c60 2024-05-04T07:50:55.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f0fb1e00640 1 -- 172.21.15.136:0/3542229840 reap_dead start 2024-05-04T07:50:55.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.601+0000 7fd1d8e00640 1 -- start start 2024-05-04T07:50:55.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.602+0000 7f0fb1400640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 0x7f0f94004060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001a70 tx=0x7f0f94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509f59cdd905b8d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.600+0000 7f1a52c00640 1 -- 172.21.15.136:0/3128016121 wait complete. 2024-05-04T07:50:55.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0001690 con 0x7f0f94003c60 2024-05-04T07:50:55.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 0x7fd1d414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc6403c6d0 con 0x7efc6c15f8a0 2024-05-04T07:50:55.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40cc080 0x7fd1d40c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 0x7fd1d40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40cf360 con 0x7fd1d415b320 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d40cf080 con 0x7fd1d40728e0 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d8e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d40cf640 con 0x7fd1d40cc080 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4bc004800 0x7fb4bc004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009bf0 tx=0x7fb4bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ced25dab720705 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa002e070 con 0x7f0f94003c60 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 0x7fd1d414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 0x7fd1d40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d1e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 0x7fd1d414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:58976/0 (socket says 172.21.15.136:58976) 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d1e00640 1 -- 172.21.15.136:0/1055221425 learned_addr learned my addr 172.21.15.136:0/1055221425 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fd1d1400640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40cc080 0x7fd1d40c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fd1d2800640 1 -- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40cc080 msgr2=0x7fd1d40c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fd1d2800640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40cc080 0x7fd1d40c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fd1d2800640 1 -- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 msgr2=0x7fd1d414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fd1d2800640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 0x7fd1d414bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fd1d2800640 1 -- 172.21.15.136:0/1055221425 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d414c5e0 con 0x7fd1d415b320 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7f1a52c00640 1 Processor -- start 2024-05-04T07:50:55.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7f1a52c00640 1 -- start start 2024-05-04T07:50:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8036070 con 0x7fb4bc004800 2024-05-04T07:50:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8031400 con 0x7fb4bc004800 2024-05-04T07:50:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fb4d6a00640 1 -- 172.21.15.136:0/3928160317 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8009630 con 0x7fb4bc004800 2024-05-04T07:50:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.603+0000 7f0fabe00640 1 -- 172.21.15.136:0/3542229840 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00048a0 con 0x7f0f94003c60 2024-05-04T07:50:55.631 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0c80127a0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7f0fb3e00640 1 -- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 msgr2=0x7f0f94004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 0x7f0f94004060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001a70 tx=0x7f0f94005830 comp rx=0 tx=0).stop 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.604+0000 7efc63400640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 0x7efc4c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc640b8660 con 0x7efc6c15f8a0 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 -- 172.21.15.136:0/3928160317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4bc004800 msgr2=0x7fb4bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3928160317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4bc004800 0x7fb4bc004c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009bf0 tx=0x7fb4bc005830 comp rx=0 tx=0).stop 2024-05-04T07:50:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fd1d2800640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 0x7fd1d40c9db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00bf90 tx=0x7fd1cc00e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dce00640 1 -- 172.21.15.136:0/3928160317 reap_dead start 2024-05-04T07:50:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7f0fb3e00640 1 -- 172.21.15.136:0/3542229840 shutdown_connections 2024-05-04T07:50:55.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 -- 172.21.15.136:0/3928160317 shutdown_connections 2024-05-04T07:50:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 -- 172.21.15.136:0/3928160317 >> 172.21.15.136:0/3928160317 conn(0x7fb4d80d0c50 msgr2=0x7fb4d80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc01a070 con 0x7fd1d415b320 2024-05-04T07:50:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00eb20 con 0x7fd1d415b320 2024-05-04T07:50:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc003990 con 0x7fd1d415b320 2024-05-04T07:50:55.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7f1a52c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 -- 172.21.15.136:0/3928160317 shutdown_connections 2024-05-04T07:50:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fb4dee00640 1 -- 172.21.15.136:0/3928160317 wait complete. 2024-05-04T07:50:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d414c8c0 con 0x7fd1d415b320 2024-05-04T07:50:55.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.606+0000 7efc6aa00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 0x7efc4c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/3542229840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f94003c60 0x7f0f94004060 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7f0fb3e00640 1 -- 172.21.15.136:0/3542229840 >> 172.21.15.136:0/3542229840 conn(0x7f0fac0d0c50 msgr2=0x7f0fac0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.605+0000 7f0fb3e00640 1 -- 172.21.15.136:0/3542229840 shutdown_connections 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.606+0000 7f0fb3e00640 1 -- 172.21.15.136:0/3542229840 wait complete. 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.606+0000 7fc0cd600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 0x7fc0b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7f1a52c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a4c0d1a50 0x7f1a4c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7f1a52c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 0x7f1a4c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7f1a52c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b6810 con 0x7f1a4c0b6140 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7f1a52c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b6690 con 0x7f1a4c0d1a50 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7f1a52c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d1e30 con 0x7f1a4c15f8a0 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7efc6aa00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 0x7efc4c0787c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc58001010 tx=0x7efc58001d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.606+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc0c80989e0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7fc0d5c00640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 0x7fc0b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.607+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d414ce80 con 0x7fd1d415b320 2024-05-04T07:50:55.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 0x7f1a4c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f0fb3e00640 1 Processor -- start 2024-05-04T07:50:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a4be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33464/0 (socket says 172.21.15.136:33464) 2024-05-04T07:50:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a4be00640 1 -- 172.21.15.136:0/3495683548 learned_addr learned my addr 172.21.15.136:0/3495683548 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 0x7f1a4c157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:33844/0 (socket says 172.21.15.136:33844) 2024-05-04T07:50:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.608+0000 7f1a4b400640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a4c0d1a50 0x7f1a4c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7fb4dee00640 1 Processor -- start 2024-05-04T07:50:55.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 -- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 msgr2=0x7f1a4c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 0x7f1a4c157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 -- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a4c0d1a50 msgr2=0x7f1a4c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a4c0d1a50 0x7f1a4c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 -- 172.21.15.136:0/3495683548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c160e10 con 0x7f1a4c0b6140 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a4be00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c840 tx=0x7f1a4400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44017070 con 0x7f1a4c0b6140 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7fc0d5c00640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 0x7fc0b4078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0034000 tx=0x7fc0c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c0b90b0 con 0x7f1a4c0b6140 2024-05-04T07:50:55.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c0b9670 con 0x7f1a4c0b6140 2024-05-04T07:50:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.609+0000 7fb4dee00640 1 -- start start 2024-05-04T07:50:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.610+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4400a640 con 0x7f1a4c0b6140 2024-05-04T07:50:55.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.610+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400a9f0 con 0x7f1a4c0b6140 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 0x7fb4d80b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4d8159310 0x7fb4d8156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d4069470 con 0x7fd1d415b320 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80cf8f0 con 0x7fb4d81fcc20 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d80cf610 con 0x7fb4d8159310 2024-05-04T07:50:55.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d8166e00 con 0x7fb4bc004800 2024-05-04T07:50:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd1cc01d070 con 0x7fd1d415b320 2024-05-04T07:50:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.610+0000 7f0fb3e00640 1 -- start start 2024-05-04T07:50:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33480/0 (socket says 172.21.15.136:33480) 2024-05-04T07:50:55.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4dce00640 1 -- 172.21.15.136:0/3589071399 learned_addr learned my addr 172.21.15.136:0/3589071399 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4d7e00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 0x7fb4d80b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a24005290 con 0x7f1a4c0b6140 2024-05-04T07:50:55.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.611+0000 7fb4d7400640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4d8159310 0x7fb4d8156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7f0fb3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7f0fb3e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4dce00640 1 -- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 msgr2=0x7fb4d80b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4dce00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 0x7fb4d80b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4dce00640 1 -- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4d8159310 msgr2=0x7fb4d8156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4dce00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4d8159310 0x7fb4d8156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7f0fb1400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7f0fb1400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:59014/0 (socket says 172.21.15.136:59014) 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4dce00640 1 -- 172.21.15.136:0/3589071399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d8156780 con 0x7fb4d81fcc20 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7fb4d7e00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 0x7fb4d80b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.612+0000 7f0fb0a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb0a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33488/0 (socket says 172.21.15.136:33488) 2024-05-04T07:50:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb1400640 1 -- 172.21.15.136:0/494785510 learned_addr learned my addr 172.21.15.136:0/494785510 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7fb4dce00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0002030 tx=0x7fb4d000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 0x7f0fac152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac166e00 con 0x7f0fac0c49b0 2024-05-04T07:50:55.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a4401a070 con 0x7f1a4c0b6140 2024-05-04T07:50:55.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0cf8f0 con 0x7f0f94003c60 2024-05-04T07:50:55.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7fd1ca000640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 0x7fd1b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0fac0d08c0 con 0x7f0fac0c4e30 2024-05-04T07:50:55.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.613+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd1cc09c060 con 0x7fd1d415b320 2024-05-04T07:50:55.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7fd1d1e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 0x7fd1b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb1e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 0x7f0fac152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 -- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 msgr2=0x7f0fac152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 0x7f0fac152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 -- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 msgr2=0x7f0fac0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac0c9fb0 con 0x7f0fac0c49b0 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb1400640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb1e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 0x7f0fac152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.615+0000 7f1a43e00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 0x7f1a2c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.614+0000 7f0fb0a00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800d7b0 tx=0x7f0f9800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.615+0000 7fd1d1e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 0x7fd1b40787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0007fd0 tx=0x7fd1c0007200 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.615+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1a44096e70 con 0x7f1a4c0b6140 2024-05-04T07:50:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.615+0000 7f1a4b400640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 0x7f1a2c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.615+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0d014faa0 con 0x7fc0d00d1e30 2024-05-04T07:50:55.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.616+0000 7f1a4b400640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 0x7f1a2c0787c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1a38034000 tx=0x7f1a3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.617+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc64032e20 con 0x7efc6c15f8a0 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.618+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f12a803d440 con 0x7f12bc0b4a00 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.620+0000 7f12b3e00640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 0x7f129c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.620+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f12a80b92d0 con 0x7f12bc0b4a00 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.621+0000 7f12bbe00640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 0x7f129c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.621+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98016070 con 0x7f0fac0c49b0 2024-05-04T07:50:55.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.621+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000bb50 con 0x7fb4d81fcc20 2024-05-04T07:50:55.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.622+0000 7f12bbe00640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 0x7f129c078860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12b4001530 tx=0x7f12b4007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.622+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd1cc060610 con 0x7fd1d415b320 2024-05-04T07:50:55.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.622+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d80b3f80 con 0x7fb4d81fcc20 2024-05-04T07:50:55.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.622+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d81fc420 con 0x7fb4d81fcc20 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.621+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac0ca290 con 0x7f0fac0c49b0 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.621+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac14fad0 con 0x7f0fac0c49b0 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.623+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fac070870 con 0x7f0fac0c49b0 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.624+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d8069470 con 0x7fb4d81fcc20 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.626+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d000bcf0 con 0x7fb4d81fcc20 2024-05-04T07:50:55.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.626+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000bea0 con 0x7fb4d81fcc20 2024-05-04T07:50:55.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.627+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1a4c160e10 con 0x7f1a4c0b6140 2024-05-04T07:50:55.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.627+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f98008830 con 0x7f0fac0c49b0 2024-05-04T07:50:55.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.627+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98020060 con 0x7f0fac0c49b0 2024-05-04T07:50:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.630+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4d001b020 con 0x7fb4d81fcc20 2024-05-04T07:50:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.632+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f12a8082840 con 0x7f12bc0b4a00 2024-05-04T07:50:55.658 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.632+0000 7fb4cfe00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 0x7fb4b80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.632+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f98019070 con 0x7f0fac0c49b0 2024-05-04T07:50:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.632+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb4d0098400 con 0x7fb4d81fcc20 2024-05-04T07:50:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.633+0000 7fb4d7e00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 0x7fb4b80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.635+0000 7fb4d7e00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 0x7fb4b80787c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009b10 tx=0x7fb4c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.635+0000 7f0fa9600640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.635+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f98097ed0 con 0x7f0fac0c49b0 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.636+0000 7f0fb1400640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.637+0000 7f0fb1400640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 0x7f0f8c078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001a70 tx=0x7f0fa0007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.639+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4d0022070 con 0x7fb4d81fcc20 2024-05-04T07:50:55.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.650+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fac070870 con 0x7f0fac0c49b0 2024-05-04T07:50:55.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.997+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7eff5803a540 con 0x7eff5803e830 2024-05-04T07:50:55.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:55.998+0000 7eff53e00640 1 -- 172.21.15.136:0/2819466610 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff4c081700 con 0x7eff5803e830 2024-05-04T07:50:55.998 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:56.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.002+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 msgr2=0x7eff400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.002+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 0x7eff400787c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff580e3ca0 tx=0x7eff54009040 comp rx=0 tx=0).stop 2024-05-04T07:50:56.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.002+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 msgr2=0x7eff5804eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009870 tx=0x7eff4c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 shutdown_connections 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7eff40076300 0x7eff400787c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff580e30b0 0x7eff58055db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff580542f0 0x7eff580e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 --2- 172.21.15.136:0/2819466610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff5803e830 0x7eff5804eb20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.003+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 >> 172.21.15.136:0/2819466610 conn(0x7eff580559d0 msgr2=0x7eff580e2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.004+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 shutdown_connections 2024-05-04T07:50:56.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.004+0000 7eff66e00640 1 -- 172.21.15.136:0/2819466610 wait complete. 2024-05-04T07:50:56.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2024-05-04T07:50:56.031 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.054+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1a24005580 con 0x7f1a4c0b6140 2024-05-04T07:50:56.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.055+0000 7f1a43e00640 1 -- 172.21.15.136:0/3495683548 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a4405fe30 con 0x7f1a4c0b6140 2024-05-04T07:50:56.056 INFO:teuthology.orchestra.run.smithi136.stdout:55834574860 2024-05-04T07:50:56.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.057+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 msgr2=0x7f1a2c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.057+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 0x7f1a2c0787c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1a38034000 tx=0x7f1a3802e000 comp rx=0 tx=0).stop 2024-05-04T07:50:56.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.057+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 msgr2=0x7f1a4c204d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.057+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c840 tx=0x7f1a4400cd00 comp rx=0 tx=0).stop 2024-05-04T07:50:56.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.057+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efc44005850 con 0x7efc6c15f8a0 2024-05-04T07:50:56.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 shutdown_connections 2024-05-04T07:50:56.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f1a2c076300 0x7f1a2c0787c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a4c15f8a0 0x7f1a4c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a4c0d1a50 0x7f1a4c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 --2- 172.21.15.136:0/3495683548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a4c0b6140 0x7f1a4c204d30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 >> 172.21.15.136:0/3495683548 conn(0x7f1a4c0d5080 msgr2=0x7f1a4c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 shutdown_connections 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7efc63400640 1 -- 172.21.15.136:0/3505426750 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc64088e20 con 0x7efc6c15f8a0 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:56.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.058+0000 7f1a52c00640 1 -- 172.21.15.136:0/3495683548 wait complete. 2024-05-04T07:50:56.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 msgr2=0x7efc4c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 0x7efc4c0787c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc58001010 tx=0x7efc58001d30 comp rx=0 tx=0).stop 2024-05-04T07:50:56.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 msgr2=0x7efc6c06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc6402a700 tx=0x7efc640046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 shutdown_connections 2024-05-04T07:50:56.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efc4c076300 0x7efc4c0787c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc6c15f8a0 0x7efc6c06e550 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc6c0d1a50 0x7efc6c06e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 --2- 172.21.15.136:0/3505426750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc6c0b6140 0x7efc6c1fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 >> 172.21.15.136:0/3505426750 conn(0x7efc6c0d5080 msgr2=0x7efc6c0d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.062+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 shutdown_connections 2024-05-04T07:50:56.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.063+0000 7efc71e00640 1 -- 172.21.15.136:0/3505426750 wait complete. 2024-05-04T07:50:56.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.5 2024-05-04T07:50:56.077 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.080+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc0d00d4b70 con 0x7fc0d00d1e30 2024-05-04T07:50:56.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.081+0000 7fc0cd600640 1 -- 172.21.15.136:0/1256616787 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0d00d4b70 con 0x7fc0d00d1e30 2024-05-04T07:50:56.082 INFO:teuthology.orchestra.run.smithi136.stdout:55834574860 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 msgr2=0x7fc0b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 0x7fc0b4078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0034000 tx=0x7fc0c002e000 comp rx=0 tx=0).stop 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 msgr2=0x7fc0d014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc0c800caa0 tx=0x7fc0c800cf60 comp rx=0 tx=0).stop 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 shutdown_connections 2024-05-04T07:50:56.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc0b40762d0 0x7fc0b4078790 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.084+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0d00d1e30 0x7fc0d014e660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.085+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0d00d1a50 0x7fc0d01f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.085+0000 7fc0d8600640 1 --2- 172.21.15.136:0/1256616787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0d00b6140 0x7fc0d00ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.085+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 >> 172.21.15.136:0/1256616787 conn(0x7fc0d00d5080 msgr2=0x7fc0d006d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.085+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 shutdown_connections 2024-05-04T07:50:56.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.085+0000 7fc0d8600640 1 -- 172.21.15.136:0/1256616787 wait complete. 2024-05-04T07:50:56.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.088+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb4d80b4440 con 0x7fb4d81fcc20 2024-05-04T07:50:56.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2024-05-04T07:50:56.089 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.088+0000 7fb4cfe00640 1 -- 172.21.15.136:0/3589071399 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4d0061980 con 0x7fb4d81fcc20 2024-05-04T07:50:56.089 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.090 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:56.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.089+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd1d40cb880 con 0x7fd1d415b320 2024-05-04T07:50:56.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.089+0000 7fd1ca000640 1 -- 172.21.15.136:0/1055221425 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1cc064910 con 0x7fd1d415b320 2024-05-04T07:50:56.090 INFO:teuthology.orchestra.run.smithi136.stdout:55834574858 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 msgr2=0x7fb4b80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 0x7fb4b80787c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4009b10 tx=0x7fb4c4008040 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 msgr2=0x7fb4d80c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0002030 tx=0x7fb4d000b4a0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 shutdown_connections 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb4b8076300 0x7fb4b80787c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4d81fcc20 0x7fb4d80c58c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4d8159310 0x7fb4d8156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 --2- 172.21.15.136:0/3589071399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc004800 0x7fb4d80b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.091+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 >> 172.21.15.136:0/3589071399 conn(0x7fb4d80d0c50 msgr2=0x7fb4d806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 shutdown_connections 2024-05-04T07:50:56.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fb4dee00640 1 -- 172.21.15.136:0/3589071399 wait complete. 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 msgr2=0x7fd1b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 0x7fd1b40787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0007fd0 tx=0x7fd1c0007200 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 msgr2=0x7fd1d40c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 0x7fd1d40c9db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc00bf90 tx=0x7fd1cc00e490 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 shutdown_connections 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd1b4076320 0x7fd1b40787e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1d415b320 0x7fd1d40c9db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1d40cc080 0x7fd1d40c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.092+0000 7fd1d8e00640 1 --2- 172.21.15.136:0/1055221425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1d40728e0 0x7fd1d414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.093+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 >> 172.21.15.136:0/1055221425 conn(0x7fd1d40d0c50 msgr2=0x7fd1d40cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.093+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 shutdown_connections 2024-05-04T07:50:56.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.093+0000 7fd1d8e00640 1 -- 172.21.15.136:0/1055221425 wait complete. 2024-05-04T07:50:56.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.095+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f12bc068e80 con 0x7f12bc0b4a00 2024-05-04T07:50:56.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.096+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0fac069470 con 0x7f0fac0c49b0 2024-05-04T07:50:56.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.096+0000 7f12b3e00640 1 -- 172.21.15.136:0/254150185 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12a8082140 con 0x7f12bc0b4a00 2024-05-04T07:50:56.097 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:56.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.097+0000 7f0fa9600640 1 -- 172.21.15.136:0/494785510 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f98097090 con 0x7f0fac0c49b0 2024-05-04T07:50:56.098 INFO:teuthology.orchestra.run.smithi136.stdout:55834574859 2024-05-04T07:50:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.099+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 msgr2=0x7f129c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.099+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 0x7f129c078860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f12b4001530 tx=0x7f12b4007a80 comp rx=0 tx=0).stop 2024-05-04T07:50:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.099+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 msgr2=0x7f12bc0c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.099+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12a80098c0 tx=0x7f12a80046c0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 shutdown_connections 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f129c0763a0 0x7f129c078860 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12bc1629c0 0x7f12bc0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12bc0b4a00 0x7f12bc0c9c20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 --2- 172.21.15.136:0/254150185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12bc0b4000 0x7f12bc15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 >> 172.21.15.136:0/254150185 conn(0x7f12bc09e3f0 msgr2=0x7f12bc0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 shutdown_connections 2024-05-04T07:50:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f12c3200640 1 -- 172.21.15.136:0/254150185 wait complete. 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 msgr2=0x7f0f8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 0x7f0f8c078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0001a70 tx=0x7f0fa0007000 comp rx=0 tx=0).stop 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 msgr2=0x7f0fac151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.100+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800d7b0 tx=0x7f0f9800dc70 comp rx=0 tx=0).stop 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 shutdown_connections 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f8c0762d0 0x7f0f8c078790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fac0c4e30 0x7f0fac152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fac0c49b0 0x7f0fac151c00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 --2- 172.21.15.136:0/494785510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f94003c60 0x7f0fac0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 >> 172.21.15.136:0/494785510 conn(0x7f0fac0d0c50 msgr2=0x7f0fac06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 shutdown_connections 2024-05-04T07:50:56.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.101+0000 7f0fb3e00640 1 -- 172.21.15.136:0/494785510 wait complete. 2024-05-04T07:50:56.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.1 2024-05-04T07:50:56.112 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.2 2024-05-04T07:50:56.115 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2024-05-04T07:50:56.117 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.3 2024-05-04T07:50:56.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.7 2024-05-04T07:50:56.129 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.129 DEBUG:teuthology.parallel:result is None 2024-05-04T07:50:56.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T07:50:56.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:50:56.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.363+0000 7fe787e00640 1 Processor -- start 2024-05-04T07:50:56.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.363+0000 7fe787e00640 1 -- start start 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe787e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7880afc80 0x7fe7880cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe787e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7880ce8d0 0x7fe788071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe787e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe788072290 con 0x7fe78806f220 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe787e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe7880d1840 con 0x7fe7880ce8d0 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe787e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe7880cee00 con 0x7fe7880afc80 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe786000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7880ce8d0 0x7fe788071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe786000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7880ce8d0 0x7fe788071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33498/0 (socket says 172.21.15.136:33498) 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.365+0000 7fe786000640 1 -- 172.21.15.136:0/1476764044 learned_addr learned my addr 172.21.15.136:0/1476764044 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:56.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.366+0000 7fe786a00640 1 --2- 172.21.15.136:0/1476764044 >> v2:172.21.15.142:3300/0 conn(0x7fe7880afc80 0x7fe7880cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.366+0000 7fe786000640 1 -- 172.21.15.136:0/1476764044 >> v2:172.21.15.142:3300/0 conn(0x7fe7880afc80 msgr2=0x7fe7880cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:56.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.366+0000 7fe786000640 1 --2- 172.21.15.136:0/1476764044 >> v2:172.21.15.142:3300/0 conn(0x7fe7880afc80 0x7fe7880cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.366+0000 7fe786000640 1 -- 172.21.15.136:0/1476764044 >> v1:172.21.15.142:6789/0 conn(0x7fe78806f220 legacy=0x7fe78806f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:56.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.366+0000 7fe786000640 1 -- 172.21.15.136:0/1476764044 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7880cf0e0 con 0x7fe7880ce8d0 2024-05-04T07:50:56.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.367+0000 7fe786000640 1 --2- 172.21.15.136:0/1476764044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7880ce8d0 0x7fe788071d50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe78806d7b0 tx=0x7fe77002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41667d7659d4efca server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.367+0000 7fe785600640 1 -- 172.21.15.136:0/1476764044 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770037070 con 0x7fe7880ce8d0 2024-05-04T07:50:56.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.367+0000 7fe785600640 1 -- 172.21.15.136:0/1476764044 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe770032440 con 0x7fe7880ce8d0 2024-05-04T07:50:56.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.367+0000 7fe785600640 1 -- 172.21.15.136:0/1476764044 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770032810 con 0x7fe7880ce8d0 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 -- 172.21.15.136:0/1476764044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7880ce8d0 msgr2=0x7fe788071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 --2- 172.21.15.136:0/1476764044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7880ce8d0 0x7fe788071d50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe78806d7b0 tx=0x7fe77002a1e0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 -- 172.21.15.136:0/1476764044 shutdown_connections 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 --2- 172.21.15.136:0/1476764044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7880ce8d0 0x7fe788071d50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 --2- 172.21.15.136:0/1476764044 >> v2:172.21.15.142:3300/0 conn(0x7fe7880afc80 0x7fe7880cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 -- 172.21.15.136:0/1476764044 >> 172.21.15.136:0/1476764044 conn(0x7fe7880d09d0 msgr2=0x7fe7880d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 -- 172.21.15.136:0/1476764044 shutdown_connections 2024-05-04T07:50:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.368+0000 7fe787e00640 1 -- 172.21.15.136:0/1476764044 wait complete. 2024-05-04T07:50:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.370+0000 7fe787e00640 1 Processor -- start 2024-05-04T07:50:56.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.370+0000 7fe787e00640 1 -- start start 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7880afc80 0x7fe7881deec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7880ce8d0 0x7fe7880c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7880cf980 con 0x7fe78806f220 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe7880cf6a0 con 0x7fe7880ce8d0 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe787e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe7880b0060 con 0x7fe7880afc80 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe786a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe786a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33504/0 (socket says 172.21.15.136:33504) 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.371+0000 7fe786a00640 1 -- 172.21.15.136:0/1635200529 learned_addr learned my addr 172.21.15.136:0/1635200529 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 -- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7880afc80 msgr2=0x7fe7881deec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7880afc80 0x7fe7881deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 -- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7880ce8d0 msgr2=0x7fe7880c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7880ce8d0 0x7fe7880c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 -- 172.21.15.136:0/1635200529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7880c8840 con 0x7fe78806f220 2024-05-04T07:50:56.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe786a00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe77800d5f0 tx=0x7fe77800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780125f0 con 0x7fe78806f220 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe778019070 con 0x7fe78806f220 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780129d0 con 0x7fe78806f220 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7880c52c0 con 0x7fe78806f220 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.372+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7880c5880 con 0x7fe78806f220 2024-05-04T07:50:56.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.374+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe788069400 con 0x7fe78806f220 2024-05-04T07:50:56.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.375+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe778012b70 con 0x7fe78806f220 2024-05-04T07:50:56.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.376+0000 7fe77ea00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.376+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe778097d80 con 0x7fe78806f220 2024-05-04T07:50:56.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.376+0000 7fe786000640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.376+0000 7fe786000640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 0x7fe764078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe770034000 tx=0x7fe77002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.380+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe778061390 con 0x7fe78806f220 2024-05-04T07:50:56.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.566+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7880b6470 con 0x7fe7640762d0 2024-05-04T07:50:56.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.590+0000 7fe77ea00640 1 -- 172.21.15.136:0/1635200529 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7fe7880b6470 con 0x7fe7640762d0 2024-05-04T07:50:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:56.597 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:50:56.598 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.597+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 msgr2=0x7fe764078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.597+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 0x7fe764078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe770034000 tx=0x7fe77002c000 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 msgr2=0x7fe7881e5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe77800d5f0 tx=0x7fe77800dab0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 shutdown_connections 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7640762d0 0x7fe764078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7880ce8d0 0x7fe7880c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7880afc80 0x7fe7881deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 --2- 172.21.15.136:0/1635200529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe78806f220 0x7fe7881e5d20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 >> 172.21.15.136:0/1635200529 conn(0x7fe7880d09d0 msgr2=0x7fe7880b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 shutdown_connections 2024-05-04T07:50:56.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.598+0000 7fe787e00640 1 -- 172.21.15.136:0/1635200529 wait complete. 2024-05-04T07:50:56.617 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-04T07:50:55.280226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004997"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908156+0000","last_change":"2024-05-04T07:50:26.511444+0000","last_active":"2024-05-04T07:50:34.908156+0000","last_peered":"2024-05-04T07:50:34.908156+0000","last_clean":"2024-05-04T07:50:34.908156+0000","last_became_active":"2024-05-04T07:50:26.511184+0000","last_became_peered":"2024-05-04T07:50:26.511184+0000","last_unstale":"2024-05-04T07:50:34.908156+0000","last_undegraded":"2024-05-04T07:50:34.908156+0000","last_fullsized":"2024-05-04T07:50:34.908156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885131+0000","last_change":"2024-05-04T07:50:27.511810+0000","last_active":"2024-05-04T07:50:34.885131+0000","last_peered":"2024-05-04T07:50:34.885131+0000","last_clean":"2024-05-04T07:50:34.885131+0000","last_became_active":"2024-05-04T07:50:27.511405+0000","last_became_peered":"2024-05-04T07:50:27.511405+0000","last_unstale":"2024-05-04T07:50:34.885131+0000","last_undegraded":"2024-05-04T07:50:34.885131+0000","last_fullsized":"2024-05-04T07:50:34.885131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883149+0000","last_change":"2024-05-04T07:50:31.757139+0000","last_active":"2024-05-04T07:50:34.883149+0000","last_peered":"2024-05-04T07:50:34.883149+0000","last_clean":"2024-05-04T07:50:34.883149+0000","last_became_active":"2024-05-04T07:50:31.756650+0000","last_became_peered":"2024-05-04T07:50:31.756650+0000","last_unstale":"2024-05-04T07:50:34.883149+0000","last_undegraded":"2024-05-04T07:50:34.883149+0000","last_fullsized":"2024-05-04T07:50:34.883149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885411+0000","last_change":"2024-05-04T07:50:26.515716+0000","last_active":"2024-05-04T07:50:34.885411+0000","last_peered":"2024-05-04T07:50:34.885411+0000","last_clean":"2024-05-04T07:50:34.885411+0000","last_became_active":"2024-05-04T07:50:26.515369+0000","last_became_peered":"2024-05-04T07:50:26.515369+0000","last_unstale":"2024-05-04T07:50:34.885411+0000","last_undegraded":"2024-05-04T07:50:34.885411+0000","last_fullsized":"2024-05-04T07:50:34.885411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907863+0000","last_change":"2024-05-04T07:50:27.532568+0000","last_active":"2024-05-04T07:50:34.907863+0000","last_peered":"2024-05-04T07:50:34.907863+0000","last_clean":"2024-05-04T07:50:34.907863+0000","last_became_active":"2024-05-04T07:50:27.532259+0000","last_became_peered":"2024-05-04T07:50:27.532259+0000","last_unstale":"2024-05-04T07:50:34.907863+0000","last_undegraded":"2024-05-04T07:50:34.907863+0000","last_fullsized":"2024-05-04T07:50:34.907863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574294+0000","last_change":"2024-05-04T07:50:31.571444+0000","last_active":"2024-05-04T07:50:32.574294+0000","last_peered":"2024-05-04T07:50:32.574294+0000","last_clean":"2024-05-04T07:50:32.574294+0000","last_became_active":"2024-05-04T07:50:31.570161+0000","last_became_peered":"2024-05-04T07:50:31.570161+0000","last_unstale":"2024-05-04T07:50:32.574294+0000","last_undegraded":"2024-05-04T07:50:32.574294+0000","last_fullsized":"2024-05-04T07:50:32.574294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:20.105139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.520446+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.519707+0000","last_became_peered":"2024-05-04T07:50:26.519707+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:04:46.769896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431704+0000","last_change":"2024-05-04T07:50:27.531288+0000","last_active":"2024-05-04T07:50:34.431704+0000","last_peered":"2024-05-04T07:50:34.431704+0000","last_clean":"2024-05-04T07:50:34.431704+0000","last_became_active":"2024-05-04T07:50:27.531005+0000","last_became_peered":"2024-05-04T07:50:27.531005+0000","last_unstale":"2024-05-04T07:50:34.431704+0000","last_undegraded":"2024-05-04T07:50:34.431704+0000","last_fullsized":"2024-05-04T07:50:34.431704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575189+0000","last_change":"2024-05-04T07:50:31.568998+0000","last_active":"2024-05-04T07:50:32.575189+0000","last_peered":"2024-05-04T07:50:32.575189+0000","last_clean":"2024-05-04T07:50:32.575189+0000","last_became_active":"2024-05-04T07:50:31.568443+0000","last_became_peered":"2024-05-04T07:50:31.568443+0000","last_unstale":"2024-05-04T07:50:32.575189+0000","last_undegraded":"2024-05-04T07:50:32.575189+0000","last_fullsized":"2024-05-04T07:50:32.575189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:11.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675279+0000","last_change":"2024-05-04T07:50:26.523596+0000","last_active":"2024-05-04T07:50:34.675279+0000","last_peered":"2024-05-04T07:50:34.675279+0000","last_clean":"2024-05-04T07:50:34.675279+0000","last_became_active":"2024-05-04T07:50:26.523247+0000","last_became_peered":"2024-05-04T07:50:26.523247+0000","last_unstale":"2024-05-04T07:50:34.675279+0000","last_undegraded":"2024-05-04T07:50:34.675279+0000","last_fullsized":"2024-05-04T07:50:34.675279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431910+0000","last_change":"2024-05-04T07:50:27.527272+0000","last_active":"2024-05-04T07:50:34.431910+0000","last_peered":"2024-05-04T07:50:34.431910+0000","last_clean":"2024-05-04T07:50:34.431910+0000","last_became_active":"2024-05-04T07:50:27.526746+0000","last_became_peered":"2024-05-04T07:50:27.526746+0000","last_unstale":"2024-05-04T07:50:34.431910+0000","last_undegraded":"2024-05-04T07:50:34.431910+0000","last_fullsized":"2024-05-04T07:50:34.431910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574307+0000","last_change":"2024-05-04T07:50:31.557824+0000","last_active":"2024-05-04T07:50:32.574307+0000","last_peered":"2024-05-04T07:50:32.574307+0000","last_clean":"2024-05-04T07:50:32.574307+0000","last_became_active":"2024-05-04T07:50:31.557272+0000","last_became_peered":"2024-05-04T07:50:31.557272+0000","last_unstale":"2024-05-04T07:50:32.574307+0000","last_undegraded":"2024-05-04T07:50:32.574307+0000","last_fullsized":"2024-05-04T07:50:32.574307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:15.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574756+0000","last_change":"2024-05-04T07:50:27.530293+0000","last_active":"2024-05-04T07:50:32.574756+0000","last_peered":"2024-05-04T07:50:32.574756+0000","last_clean":"2024-05-04T07:50:32.574756+0000","last_became_active":"2024-05-04T07:50:27.529984+0000","last_became_peered":"2024-05-04T07:50:27.529984+0000","last_unstale":"2024-05-04T07:50:32.574756+0000","last_undegraded":"2024-05-04T07:50:32.574756+0000","last_fullsized":"2024-05-04T07:50:32.574756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.521571+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.521188+0000","last_became_peered":"2024-05-04T07:50:26.521188+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:11.871066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576679+0000","last_change":"2024-05-04T07:50:31.570676+0000","last_active":"2024-05-04T07:50:32.576679+0000","last_peered":"2024-05-04T07:50:32.576679+0000","last_clean":"2024-05-04T07:50:32.576679+0000","last_became_active":"2024-05-04T07:50:31.570276+0000","last_became_peered":"2024-05-04T07:50:31.570276+0000","last_unstale":"2024-05-04T07:50:32.576679+0000","last_undegraded":"2024-05-04T07:50:32.576679+0000","last_fullsized":"2024-05-04T07:50:32.576679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884190+0000","last_change":"2024-05-04T07:50:27.532074+0000","last_active":"2024-05-04T07:50:34.884190+0000","last_peered":"2024-05-04T07:50:34.884190+0000","last_clean":"2024-05-04T07:50:34.884190+0000","last_became_active":"2024-05-04T07:50:27.529720+0000","last_became_peered":"2024-05-04T07:50:27.529720+0000","last_unstale":"2024-05-04T07:50:34.884190+0000","last_undegraded":"2024-05-04T07:50:34.884190+0000","last_fullsized":"2024-05-04T07:50:34.884190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706867+0000","last_change":"2024-05-04T07:50:26.523351+0000","last_active":"2024-05-04T07:50:34.706867+0000","last_peered":"2024-05-04T07:50:34.706867+0000","last_clean":"2024-05-04T07:50:34.706867+0000","last_became_active":"2024-05-04T07:50:26.522661+0000","last_became_peered":"2024-05-04T07:50:26.522661+0000","last_unstale":"2024-05-04T07:50:34.706867+0000","last_undegraded":"2024-05-04T07:50:34.706867+0000","last_fullsized":"2024-05-04T07:50:34.706867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574356+0000","last_change":"2024-05-04T07:50:31.569229+0000","last_active":"2024-05-04T07:50:32.574356+0000","last_peered":"2024-05-04T07:50:32.574356+0000","last_clean":"2024-05-04T07:50:32.574356+0000","last_became_active":"2024-05-04T07:50:31.568499+0000","last_became_peered":"2024-05-04T07:50:31.568499+0000","last_unstale":"2024-05-04T07:50:32.574356+0000","last_undegraded":"2024-05-04T07:50:32.574356+0000","last_fullsized":"2024-05-04T07:50:32.574356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:01.830913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883443+0000","last_change":"2024-05-04T07:50:27.528537+0000","last_active":"2024-05-04T07:50:34.883443+0000","last_peered":"2024-05-04T07:50:34.883443+0000","last_clean":"2024-05-04T07:50:34.883443+0000","last_became_active":"2024-05-04T07:50:27.528071+0000","last_became_peered":"2024-05-04T07:50:27.528071+0000","last_unstale":"2024-05-04T07:50:34.883443+0000","last_undegraded":"2024-05-04T07:50:34.883443+0000","last_fullsized":"2024-05-04T07:50:34.883443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705613+0000","last_change":"2024-05-04T07:50:26.509143+0000","last_active":"2024-05-04T07:50:34.705613+0000","last_peered":"2024-05-04T07:50:34.705613+0000","last_clean":"2024-05-04T07:50:34.705613+0000","last_became_active":"2024-05-04T07:50:26.508476+0000","last_became_peered":"2024-05-04T07:50:26.508476+0000","last_unstale":"2024-05-04T07:50:34.705613+0000","last_undegraded":"2024-05-04T07:50:34.705613+0000","last_fullsized":"2024-05-04T07:50:34.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707315+0000","last_change":"2024-05-04T07:50:31.751464+0000","last_active":"2024-05-04T07:50:34.707315+0000","last_peered":"2024-05-04T07:50:34.707315+0000","last_clean":"2024-05-04T07:50:34.707315+0000","last_became_active":"2024-05-04T07:50:31.751012+0000","last_became_peered":"2024-05-04T07:50:31.751012+0000","last_unstale":"2024-05-04T07:50:34.707315+0000","last_undegraded":"2024-05-04T07:50:34.707315+0000","last_fullsized":"2024-05-04T07:50:34.707315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576462+0000","last_change":"2024-05-04T07:50:27.503181+0000","last_active":"2024-05-04T07:50:32.576462+0000","last_peered":"2024-05-04T07:50:32.576462+0000","last_clean":"2024-05-04T07:50:32.576462+0000","last_became_active":"2024-05-04T07:50:27.502878+0000","last_became_peered":"2024-05-04T07:50:27.502878+0000","last_unstale":"2024-05-04T07:50:32.576462+0000","last_undegraded":"2024-05-04T07:50:32.576462+0000","last_fullsized":"2024-05-04T07:50:32.576462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:33.061709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675823+0000","last_change":"2024-05-04T07:50:26.516424+0000","last_active":"2024-05-04T07:50:34.675823+0000","last_peered":"2024-05-04T07:50:34.675823+0000","last_clean":"2024-05-04T07:50:34.675823+0000","last_became_active":"2024-05-04T07:50:26.515804+0000","last_became_peered":"2024-05-04T07:50:26.515804+0000","last_unstale":"2024-05-04T07:50:34.675823+0000","last_undegraded":"2024-05-04T07:50:34.675823+0000","last_fullsized":"2024-05-04T07:50:34.675823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576592+0000","last_change":"2024-05-04T07:50:31.571745+0000","last_active":"2024-05-04T07:50:32.576592+0000","last_peered":"2024-05-04T07:50:32.576592+0000","last_clean":"2024-05-04T07:50:32.576592+0000","last_became_active":"2024-05-04T07:50:31.571236+0000","last_became_peered":"2024-05-04T07:50:31.571236+0000","last_unstale":"2024-05-04T07:50:32.576592+0000","last_undegraded":"2024-05-04T07:50:32.576592+0000","last_fullsized":"2024-05-04T07:50:32.576592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907548+0000","last_change":"2024-05-04T07:50:27.520723+0000","last_active":"2024-05-04T07:50:34.907548+0000","last_peered":"2024-05-04T07:50:34.907548+0000","last_clean":"2024-05-04T07:50:34.907548+0000","last_became_active":"2024-05-04T07:50:27.520401+0000","last_became_peered":"2024-05-04T07:50:27.520401+0000","last_unstale":"2024-05-04T07:50:34.907548+0000","last_undegraded":"2024-05-04T07:50:34.907548+0000","last_fullsized":"2024-05-04T07:50:34.907548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577779+0000","last_change":"2024-05-04T07:50:26.508044+0000","last_active":"2024-05-04T07:50:32.577779+0000","last_peered":"2024-05-04T07:50:32.577779+0000","last_clean":"2024-05-04T07:50:32.577779+0000","last_became_active":"2024-05-04T07:50:26.507669+0000","last_became_peered":"2024-05-04T07:50:26.507669+0000","last_unstale":"2024-05-04T07:50:32.577779+0000","last_undegraded":"2024-05-04T07:50:32.577779+0000","last_fullsized":"2024-05-04T07:50:32.577779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576003+0000","last_change":"2024-05-04T07:50:31.751252+0000","last_active":"2024-05-04T07:50:32.576003+0000","last_peered":"2024-05-04T07:50:32.576003+0000","last_clean":"2024-05-04T07:50:32.576003+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:32.576003+0000","last_undegraded":"2024-05-04T07:50:32.576003+0000","last_fullsized":"2024-05-04T07:50:32.576003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885325+0000","last_change":"2024-05-04T07:50:27.529761+0000","last_active":"2024-05-04T07:50:34.885325+0000","last_peered":"2024-05-04T07:50:34.885325+0000","last_clean":"2024-05-04T07:50:34.885325+0000","last_became_active":"2024-05-04T07:50:27.529312+0000","last_became_peered":"2024-05-04T07:50:27.529312+0000","last_unstale":"2024-05-04T07:50:34.885325+0000","last_undegraded":"2024-05-04T07:50:34.885325+0000","last_fullsized":"2024-05-04T07:50:34.885325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705096+0000","last_change":"2024-05-04T07:50:26.510946+0000","last_active":"2024-05-04T07:50:34.705096+0000","last_peered":"2024-05-04T07:50:34.705096+0000","last_clean":"2024-05-04T07:50:34.705096+0000","last_became_active":"2024-05-04T07:50:26.510126+0000","last_became_peered":"2024-05-04T07:50:26.510126+0000","last_unstale":"2024-05-04T07:50:34.705096+0000","last_undegraded":"2024-05-04T07:50:34.705096+0000","last_fullsized":"2024-05-04T07:50:34.705096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882789+0000","last_change":"2024-05-04T07:50:31.748699+0000","last_active":"2024-05-04T07:50:34.882789+0000","last_peered":"2024-05-04T07:50:34.882789+0000","last_clean":"2024-05-04T07:50:34.882789+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:34.882789+0000","last_undegraded":"2024-05-04T07:50:34.882789+0000","last_fullsized":"2024-05-04T07:50:34.882789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706580+0000","last_change":"2024-05-04T07:50:27.517196+0000","last_active":"2024-05-04T07:50:34.706580+0000","last_peered":"2024-05-04T07:50:34.706580+0000","last_clean":"2024-05-04T07:50:34.706580+0000","last_became_active":"2024-05-04T07:50:27.516775+0000","last_became_peered":"2024-05-04T07:50:27.516775+0000","last_unstale":"2024-05-04T07:50:34.706580+0000","last_undegraded":"2024-05-04T07:50:34.706580+0000","last_fullsized":"2024-05-04T07:50:34.706580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677514+0000","last_change":"2024-05-04T07:50:26.522492+0000","last_active":"2024-05-04T07:50:34.677514+0000","last_peered":"2024-05-04T07:50:34.677514+0000","last_clean":"2024-05-04T07:50:34.677514+0000","last_became_active":"2024-05-04T07:50:26.522237+0000","last_became_peered":"2024-05-04T07:50:26.522237+0000","last_unstale":"2024-05-04T07:50:34.677514+0000","last_undegraded":"2024-05-04T07:50:34.677514+0000","last_fullsized":"2024-05-04T07:50:34.677514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:49:19.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907032+0000","last_change":"2024-05-04T07:50:31.747060+0000","last_active":"2024-05-04T07:50:34.907032+0000","last_peered":"2024-05-04T07:50:34.907032+0000","last_clean":"2024-05-04T07:50:34.907032+0000","last_became_active":"2024-05-04T07:50:31.746470+0000","last_became_peered":"2024-05-04T07:50:31.746470+0000","last_unstale":"2024-05-04T07:50:34.907032+0000","last_undegraded":"2024-05-04T07:50:34.907032+0000","last_fullsized":"2024-05-04T07:50:34.907032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432324+0000","last_change":"2024-05-04T07:50:27.525057+0000","last_active":"2024-05-04T07:50:34.432324+0000","last_peered":"2024-05-04T07:50:34.432324+0000","last_clean":"2024-05-04T07:50:34.432324+0000","last_became_active":"2024-05-04T07:50:27.518656+0000","last_became_peered":"2024-05-04T07:50:27.518656+0000","last_unstale":"2024-05-04T07:50:34.432324+0000","last_undegraded":"2024-05-04T07:50:34.432324+0000","last_fullsized":"2024-05-04T07:50:34.432324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706680+0000","last_change":"2024-05-04T07:50:26.509525+0000","last_active":"2024-05-04T07:50:34.706680+0000","last_peered":"2024-05-04T07:50:34.706680+0000","last_clean":"2024-05-04T07:50:34.706680+0000","last_became_active":"2024-05-04T07:50:26.509234+0000","last_became_peered":"2024-05-04T07:50:26.509234+0000","last_unstale":"2024-05-04T07:50:34.706680+0000","last_undegraded":"2024-05-04T07:50:34.706680+0000","last_fullsized":"2024-05-04T07:50:34.706680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705890+0000","last_change":"2024-05-04T07:50:31.564531+0000","last_active":"2024-05-04T07:50:34.705890+0000","last_peered":"2024-05-04T07:50:34.705890+0000","last_clean":"2024-05-04T07:50:34.705890+0000","last_became_active":"2024-05-04T07:50:31.563731+0000","last_became_peered":"2024-05-04T07:50:31.563731+0000","last_unstale":"2024-05-04T07:50:34.705890+0000","last_undegraded":"2024-05-04T07:50:34.705890+0000","last_fullsized":"2024-05-04T07:50:34.705890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575993+0000","last_change":"2024-05-04T07:50:27.534533+0000","last_active":"2024-05-04T07:50:32.575993+0000","last_peered":"2024-05-04T07:50:32.575993+0000","last_clean":"2024-05-04T07:50:32.575993+0000","last_became_active":"2024-05-04T07:50:27.530233+0000","last_became_peered":"2024-05-04T07:50:27.530233+0000","last_unstale":"2024-05-04T07:50:32.575993+0000","last_undegraded":"2024-05-04T07:50:32.575993+0000","last_fullsized":"2024-05-04T07:50:32.575993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:32.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431458+0000","last_change":"2024-05-04T07:50:26.519163+0000","last_active":"2024-05-04T07:50:34.431458+0000","last_peered":"2024-05-04T07:50:34.431458+0000","last_clean":"2024-05-04T07:50:34.431458+0000","last_became_active":"2024-05-04T07:50:26.518842+0000","last_became_peered":"2024-05-04T07:50:26.518842+0000","last_unstale":"2024-05-04T07:50:34.431458+0000","last_undegraded":"2024-05-04T07:50:34.431458+0000","last_fullsized":"2024-05-04T07:50:34.431458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:37.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706475+0000","last_change":"2024-05-04T07:50:31.568404+0000","last_active":"2024-05-04T07:50:34.706475+0000","last_peered":"2024-05-04T07:50:34.706475+0000","last_clean":"2024-05-04T07:50:34.706475+0000","last_became_active":"2024-05-04T07:50:31.568002+0000","last_became_peered":"2024-05-04T07:50:31.568002+0000","last_unstale":"2024-05-04T07:50:34.706475+0000","last_undegraded":"2024-05-04T07:50:34.706475+0000","last_fullsized":"2024-05-04T07:50:34.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706056+0000","last_change":"2024-05-04T07:50:27.514675+0000","last_active":"2024-05-04T07:50:34.706056+0000","last_peered":"2024-05-04T07:50:34.706056+0000","last_clean":"2024-05-04T07:50:34.706056+0000","last_became_active":"2024-05-04T07:50:27.514210+0000","last_became_peered":"2024-05-04T07:50:27.514210+0000","last_unstale":"2024-05-04T07:50:34.706056+0000","last_undegraded":"2024-05-04T07:50:34.706056+0000","last_fullsized":"2024-05-04T07:50:34.706056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571018+0000","last_change":"2024-05-04T07:50:26.519658+0000","last_active":"2024-05-04T07:50:32.571018+0000","last_peered":"2024-05-04T07:50:32.571018+0000","last_clean":"2024-05-04T07:50:32.571018+0000","last_became_active":"2024-05-04T07:50:26.519341+0000","last_became_peered":"2024-05-04T07:50:26.519341+0000","last_unstale":"2024-05-04T07:50:32.571018+0000","last_undegraded":"2024-05-04T07:50:32.571018+0000","last_fullsized":"2024-05-04T07:50:32.571018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707413+0000","last_change":"2024-05-04T07:50:31.573798+0000","last_active":"2024-05-04T07:50:34.707413+0000","last_peered":"2024-05-04T07:50:34.707413+0000","last_clean":"2024-05-04T07:50:34.707413+0000","last_became_active":"2024-05-04T07:50:31.573273+0000","last_became_peered":"2024-05-04T07:50:31.573273+0000","last_unstale":"2024-05-04T07:50:34.707413+0000","last_undegraded":"2024-05-04T07:50:34.707413+0000","last_fullsized":"2024-05-04T07:50:34.707413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906075+0000","last_change":"2024-05-04T07:50:27.524360+0000","last_active":"2024-05-04T07:50:34.906075+0000","last_peered":"2024-05-04T07:50:34.906075+0000","last_clean":"2024-05-04T07:50:34.906075+0000","last_became_active":"2024-05-04T07:50:27.524070+0000","last_became_peered":"2024-05-04T07:50:27.524070+0000","last_unstale":"2024-05-04T07:50:34.906075+0000","last_undegraded":"2024-05-04T07:50:34.906075+0000","last_fullsized":"2024-05-04T07:50:34.906075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:12.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675820+0000","last_change":"2024-05-04T07:50:26.516657+0000","last_active":"2024-05-04T07:50:34.675820+0000","last_peered":"2024-05-04T07:50:34.675820+0000","last_clean":"2024-05-04T07:50:34.675820+0000","last_became_active":"2024-05-04T07:50:26.516141+0000","last_became_peered":"2024-05-04T07:50:26.516141+0000","last_unstale":"2024-05-04T07:50:34.675820+0000","last_undegraded":"2024-05-04T07:50:34.675820+0000","last_fullsized":"2024-05-04T07:50:34.675820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907557+0000","last_change":"2024-05-04T07:50:31.756700+0000","last_active":"2024-05-04T07:50:34.907557+0000","last_peered":"2024-05-04T07:50:34.907557+0000","last_clean":"2024-05-04T07:50:34.907557+0000","last_became_active":"2024-05-04T07:50:31.756170+0000","last_became_peered":"2024-05-04T07:50:31.756170+0000","last_unstale":"2024-05-04T07:50:34.907557+0000","last_undegraded":"2024-05-04T07:50:34.907557+0000","last_fullsized":"2024-05-04T07:50:34.907557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884037+0000","last_change":"2024-05-04T07:50:27.539831+0000","last_active":"2024-05-04T07:50:34.884037+0000","last_peered":"2024-05-04T07:50:34.884037+0000","last_clean":"2024-05-04T07:50:34.884037+0000","last_became_active":"2024-05-04T07:50:27.539289+0000","last_became_peered":"2024-05-04T07:50:27.539289+0000","last_unstale":"2024-05-04T07:50:34.884037+0000","last_undegraded":"2024-05-04T07:50:34.884037+0000","last_fullsized":"2024-05-04T07:50:34.884037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431173+0000","last_change":"2024-05-04T07:50:26.513428+0000","last_active":"2024-05-04T07:50:34.431173+0000","last_peered":"2024-05-04T07:50:34.431173+0000","last_clean":"2024-05-04T07:50:34.431173+0000","last_became_active":"2024-05-04T07:50:26.512961+0000","last_became_peered":"2024-05-04T07:50:26.512961+0000","last_unstale":"2024-05-04T07:50:34.431173+0000","last_undegraded":"2024-05-04T07:50:34.431173+0000","last_fullsized":"2024-05-04T07:50:34.431173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676160+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:50:34.676160+0000","last_peered":"2024-05-04T07:50:34.676160+0000","last_clean":"2024-05-04T07:50:34.676160+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:50:34.676160+0000","last_undegraded":"2024-05-04T07:50:34.676160+0000","last_fullsized":"2024-05-04T07:50:34.676160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576262+0000","last_change":"2024-05-04T07:50:31.754509+0000","last_active":"2024-05-04T07:50:32.576262+0000","last_peered":"2024-05-04T07:50:32.576262+0000","last_clean":"2024-05-04T07:50:32.576262+0000","last_became_active":"2024-05-04T07:50:31.751388+0000","last_became_peered":"2024-05-04T07:50:31.751388+0000","last_unstale":"2024-05-04T07:50:32.576262+0000","last_undegraded":"2024-05-04T07:50:32.576262+0000","last_fullsized":"2024-05-04T07:50:32.576262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677129+0000","last_change":"2024-05-04T07:50:27.526484+0000","last_active":"2024-05-04T07:50:34.677129+0000","last_peered":"2024-05-04T07:50:34.677129+0000","last_clean":"2024-05-04T07:50:34.677129+0000","last_became_active":"2024-05-04T07:50:27.526184+0000","last_became_peered":"2024-05-04T07:50:27.526184+0000","last_unstale":"2024-05-04T07:50:34.677129+0000","last_undegraded":"2024-05-04T07:50:34.677129+0000","last_fullsized":"2024-05-04T07:50:34.677129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571639+0000","last_change":"2024-05-04T07:50:26.511552+0000","last_active":"2024-05-04T07:50:32.571639+0000","last_peered":"2024-05-04T07:50:32.571639+0000","last_clean":"2024-05-04T07:50:32.571639+0000","last_became_active":"2024-05-04T07:50:26.510510+0000","last_became_peered":"2024-05-04T07:50:26.510510+0000","last_unstale":"2024-05-04T07:50:32.571639+0000","last_undegraded":"2024-05-04T07:50:32.571639+0000","last_fullsized":"2024-05-04T07:50:32.571639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573035+0000","last_change":"2024-05-04T07:50:31.749615+0000","last_active":"2024-05-04T07:50:32.573035+0000","last_peered":"2024-05-04T07:50:32.573035+0000","last_clean":"2024-05-04T07:50:32.573035+0000","last_became_active":"2024-05-04T07:50:31.748418+0000","last_became_peered":"2024-05-04T07:50:31.748418+0000","last_unstale":"2024-05-04T07:50:32.573035+0000","last_undegraded":"2024-05-04T07:50:32.573035+0000","last_fullsized":"2024-05-04T07:50:32.573035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431745+0000","last_change":"2024-05-04T07:50:27.533824+0000","last_active":"2024-05-04T07:50:34.431745+0000","last_peered":"2024-05-04T07:50:34.431745+0000","last_clean":"2024-05-04T07:50:34.431745+0000","last_became_active":"2024-05-04T07:50:27.533561+0000","last_became_peered":"2024-05-04T07:50:27.533561+0000","last_unstale":"2024-05-04T07:50:34.431745+0000","last_undegraded":"2024-05-04T07:50:34.431745+0000","last_fullsized":"2024-05-04T07:50:34.431745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705144+0000","last_change":"2024-05-04T07:50:26.514911+0000","last_active":"2024-05-04T07:50:34.705144+0000","last_peered":"2024-05-04T07:50:34.705144+0000","last_clean":"2024-05-04T07:50:34.705144+0000","last_became_active":"2024-05-04T07:50:26.514615+0000","last_became_peered":"2024-05-04T07:50:26.514615+0000","last_unstale":"2024-05-04T07:50:34.705144+0000","last_undegraded":"2024-05-04T07:50:34.705144+0000","last_fullsized":"2024-05-04T07:50:34.705144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907253+0000","last_change":"2024-05-04T07:50:31.568892+0000","last_active":"2024-05-04T07:50:34.907253+0000","last_peered":"2024-05-04T07:50:34.907253+0000","last_clean":"2024-05-04T07:50:34.907253+0000","last_became_active":"2024-05-04T07:50:31.568427+0000","last_became_peered":"2024-05-04T07:50:31.568427+0000","last_unstale":"2024-05-04T07:50:34.907253+0000","last_undegraded":"2024-05-04T07:50:34.907253+0000","last_fullsized":"2024-05-04T07:50:34.907253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677795+0000","last_change":"2024-05-04T07:50:27.537511+0000","last_active":"2024-05-04T07:50:34.677795+0000","last_peered":"2024-05-04T07:50:34.677795+0000","last_clean":"2024-05-04T07:50:34.677795+0000","last_became_active":"2024-05-04T07:50:27.536076+0000","last_became_peered":"2024-05-04T07:50:27.536076+0000","last_unstale":"2024-05-04T07:50:34.677795+0000","last_undegraded":"2024-05-04T07:50:34.677795+0000","last_fullsized":"2024-05-04T07:50:34.677795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:49.223933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571866+0000","last_change":"2024-05-04T07:50:26.517157+0000","last_active":"2024-05-04T07:50:32.571866+0000","last_peered":"2024-05-04T07:50:32.571866+0000","last_clean":"2024-05-04T07:50:32.571866+0000","last_became_active":"2024-05-04T07:50:26.516874+0000","last_became_peered":"2024-05-04T07:50:26.516874+0000","last_unstale":"2024-05-04T07:50:32.571866+0000","last_undegraded":"2024-05-04T07:50:32.571866+0000","last_fullsized":"2024-05-04T07:50:32.571866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430645+0000","last_change":"2024-05-04T07:50:31.760635+0000","last_active":"2024-05-04T07:50:34.430645+0000","last_peered":"2024-05-04T07:50:34.430645+0000","last_clean":"2024-05-04T07:50:34.430645+0000","last_became_active":"2024-05-04T07:50:31.757079+0000","last_became_peered":"2024-05-04T07:50:31.757079+0000","last_unstale":"2024-05-04T07:50:34.430645+0000","last_undegraded":"2024-05-04T07:50:34.430645+0000","last_fullsized":"2024-05-04T07:50:34.430645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677343+0000","last_change":"2024-05-04T07:50:27.540454+0000","last_active":"2024-05-04T07:50:34.677343+0000","last_peered":"2024-05-04T07:50:34.677343+0000","last_clean":"2024-05-04T07:50:34.677343+0000","last_became_active":"2024-05-04T07:50:27.540144+0000","last_became_peered":"2024-05-04T07:50:27.540144+0000","last_unstale":"2024-05-04T07:50:34.677343+0000","last_undegraded":"2024-05-04T07:50:34.677343+0000","last_fullsized":"2024-05-04T07:50:34.677343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577699+0000","last_change":"2024-05-04T07:50:26.503229+0000","last_active":"2024-05-04T07:50:32.577699+0000","last_peered":"2024-05-04T07:50:32.577699+0000","last_clean":"2024-05-04T07:50:32.577699+0000","last_became_active":"2024-05-04T07:50:26.502831+0000","last_became_peered":"2024-05-04T07:50:26.502831+0000","last_unstale":"2024-05-04T07:50:32.577699+0000","last_undegraded":"2024-05-04T07:50:32.577699+0000","last_fullsized":"2024-05-04T07:50:32.577699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:08:59.681592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575067+0000","last_change":"2024-05-04T07:50:31.575538+0000","last_active":"2024-05-04T07:50:32.575067+0000","last_peered":"2024-05-04T07:50:32.575067+0000","last_clean":"2024-05-04T07:50:32.575067+0000","last_became_active":"2024-05-04T07:50:31.575246+0000","last_became_peered":"2024-05-04T07:50:31.575246+0000","last_unstale":"2024-05-04T07:50:32.575067+0000","last_undegraded":"2024-05-04T07:50:32.575067+0000","last_fullsized":"2024-05-04T07:50:32.575067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:59.402800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676420+0000","last_change":"2024-05-04T07:50:27.522684+0000","last_active":"2024-05-04T07:50:34.676420+0000","last_peered":"2024-05-04T07:50:34.676420+0000","last_clean":"2024-05-04T07:50:34.676420+0000","last_became_active":"2024-05-04T07:50:27.522411+0000","last_became_peered":"2024-05-04T07:50:27.522411+0000","last_unstale":"2024-05-04T07:50:34.676420+0000","last_undegraded":"2024-05-04T07:50:34.676420+0000","last_fullsized":"2024-05-04T07:50:34.676420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570481+0000","last_change":"2024-05-04T07:50:26.506955+0000","last_active":"2024-05-04T07:50:32.570481+0000","last_peered":"2024-05-04T07:50:32.570481+0000","last_clean":"2024-05-04T07:50:32.570481+0000","last_became_active":"2024-05-04T07:50:26.506608+0000","last_became_peered":"2024-05-04T07:50:26.506608+0000","last_unstale":"2024-05-04T07:50:32.570481+0000","last_undegraded":"2024-05-04T07:50:32.570481+0000","last_fullsized":"2024-05-04T07:50:32.570481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907170+0000","last_change":"2024-05-04T07:50:31.555725+0000","last_active":"2024-05-04T07:50:34.907170+0000","last_peered":"2024-05-04T07:50:34.907170+0000","last_clean":"2024-05-04T07:50:34.907170+0000","last_became_active":"2024-05-04T07:50:31.555270+0000","last_became_peered":"2024-05-04T07:50:31.555270+0000","last_unstale":"2024-05-04T07:50:34.907170+0000","last_undegraded":"2024-05-04T07:50:34.907170+0000","last_fullsized":"2024-05-04T07:50:34.907170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:44.773246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573323+0000","last_change":"2024-05-04T07:50:27.518477+0000","last_active":"2024-05-04T07:50:32.573323+0000","last_peered":"2024-05-04T07:50:32.573323+0000","last_clean":"2024-05-04T07:50:32.573323+0000","last_became_active":"2024-05-04T07:50:27.517791+0000","last_became_peered":"2024-05-04T07:50:27.517791+0000","last_unstale":"2024-05-04T07:50:32.573323+0000","last_undegraded":"2024-05-04T07:50:32.573323+0000","last_fullsized":"2024-05-04T07:50:32.573323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573574+0000","last_change":"2024-05-04T07:50:26.510434+0000","last_active":"2024-05-04T07:50:32.573574+0000","last_peered":"2024-05-04T07:50:32.573574+0000","last_clean":"2024-05-04T07:50:32.573574+0000","last_became_active":"2024-05-04T07:50:26.510119+0000","last_became_peered":"2024-05-04T07:50:26.510119+0000","last_unstale":"2024-05-04T07:50:32.573574+0000","last_undegraded":"2024-05-04T07:50:32.573574+0000","last_fullsized":"2024-05-04T07:50:32.573574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885212+0000","last_change":"2024-05-04T07:50:31.756666+0000","last_active":"2024-05-04T07:50:34.885212+0000","last_peered":"2024-05-04T07:50:34.885212+0000","last_clean":"2024-05-04T07:50:34.885212+0000","last_became_active":"2024-05-04T07:50:31.756249+0000","last_became_peered":"2024-05-04T07:50:31.756249+0000","last_unstale":"2024-05-04T07:50:34.885212+0000","last_undegraded":"2024-05-04T07:50:34.885212+0000","last_fullsized":"2024-05-04T07:50:34.885212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:37:24.803569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676890+0000","last_change":"2024-05-04T07:50:27.540674+0000","last_active":"2024-05-04T07:50:34.676890+0000","last_peered":"2024-05-04T07:50:34.676890+0000","last_clean":"2024-05-04T07:50:34.676890+0000","last_became_active":"2024-05-04T07:50:27.540424+0000","last_became_peered":"2024-05-04T07:50:27.540424+0000","last_unstale":"2024-05-04T07:50:34.676890+0000","last_undegraded":"2024-05-04T07:50:34.676890+0000","last_fullsized":"2024-05-04T07:50:34.676890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431291+0000","last_change":"2024-05-04T07:50:26.523666+0000","last_active":"2024-05-04T07:50:34.431291+0000","last_peered":"2024-05-04T07:50:34.431291+0000","last_clean":"2024-05-04T07:50:34.431291+0000","last_became_active":"2024-05-04T07:50:26.522969+0000","last_became_peered":"2024-05-04T07:50:26.522969+0000","last_unstale":"2024-05-04T07:50:34.431291+0000","last_undegraded":"2024-05-04T07:50:34.431291+0000","last_fullsized":"2024-05-04T07:50:34.431291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:51.372178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884708+0000","last_change":"2024-05-04T07:50:31.748030+0000","last_active":"2024-05-04T07:50:34.884708+0000","last_peered":"2024-05-04T07:50:34.884708+0000","last_clean":"2024-05-04T07:50:34.884708+0000","last_became_active":"2024-05-04T07:50:31.746933+0000","last_became_peered":"2024-05-04T07:50:31.746933+0000","last_unstale":"2024-05-04T07:50:34.884708+0000","last_undegraded":"2024-05-04T07:50:34.884708+0000","last_fullsized":"2024-05-04T07:50:34.884708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:09:59.415101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906640+0000","last_change":"2024-05-04T07:50:27.527928+0000","last_active":"2024-05-04T07:50:34.906640+0000","last_peered":"2024-05-04T07:50:34.906640+0000","last_clean":"2024-05-04T07:50:34.906640+0000","last_became_active":"2024-05-04T07:50:27.527533+0000","last_became_peered":"2024-05-04T07:50:27.527533+0000","last_unstale":"2024-05-04T07:50:34.906640+0000","last_undegraded":"2024-05-04T07:50:34.906640+0000","last_fullsized":"2024-05-04T07:50:34.906640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.905602+0000","last_change":"2024-05-04T07:50:26.513336+0000","last_active":"2024-05-04T07:50:34.905602+0000","last_peered":"2024-05-04T07:50:34.905602+0000","last_clean":"2024-05-04T07:50:34.905602+0000","last_became_active":"2024-05-04T07:50:26.512985+0000","last_became_peered":"2024-05-04T07:50:26.512985+0000","last_unstale":"2024-05-04T07:50:34.905602+0000","last_undegraded":"2024-05-04T07:50:34.905602+0000","last_fullsized":"2024-05-04T07:50:34.905602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:06.202371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432021+0000","last_change":"2024-05-04T07:50:31.749461+0000","last_active":"2024-05-04T07:50:34.432021+0000","last_peered":"2024-05-04T07:50:34.432021+0000","last_clean":"2024-05-04T07:50:34.432021+0000","last_became_active":"2024-05-04T07:50:31.748351+0000","last_became_peered":"2024-05-04T07:50:31.748351+0000","last_unstale":"2024-05-04T07:50:34.432021+0000","last_undegraded":"2024-05-04T07:50:34.432021+0000","last_fullsized":"2024-05-04T07:50:34.432021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676838+0000","last_change":"2024-05-04T07:50:27.521782+0000","last_active":"2024-05-04T07:50:34.676838+0000","last_peered":"2024-05-04T07:50:34.676838+0000","last_clean":"2024-05-04T07:50:34.676838+0000","last_became_active":"2024-05-04T07:50:27.521501+0000","last_became_peered":"2024-05-04T07:50:27.521501+0000","last_unstale":"2024-05-04T07:50:34.676838+0000","last_undegraded":"2024-05-04T07:50:34.676838+0000","last_fullsized":"2024-05-04T07:50:34.676838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:39.662272+0000","last_change":"2024-05-04T07:50:26.523082+0000","last_active":"2024-05-04T07:50:39.662272+0000","last_peered":"2024-05-04T07:50:39.662272+0000","last_clean":"2024-05-04T07:50:39.662272+0000","last_became_active":"2024-05-04T07:50:26.522745+0000","last_became_peered":"2024-05-04T07:50:26.522745+0000","last_unstale":"2024-05-04T07:50:39.662272+0000","last_undegraded":"2024-05-04T07:50:39.662272+0000","last_fullsized":"2024-05-04T07:50:39.662272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706176+0000","last_change":"2024-05-04T07:50:31.564157+0000","last_active":"2024-05-04T07:50:34.706176+0000","last_peered":"2024-05-04T07:50:34.706176+0000","last_clean":"2024-05-04T07:50:34.706176+0000","last_became_active":"2024-05-04T07:50:31.563164+0000","last_became_peered":"2024-05-04T07:50:31.563164+0000","last_unstale":"2024-05-04T07:50:34.706176+0000","last_undegraded":"2024-05-04T07:50:34.706176+0000","last_fullsized":"2024-05-04T07:50:34.706176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575072+0000","last_change":"2024-05-04T07:50:27.525542+0000","last_active":"2024-05-04T07:50:32.575072+0000","last_peered":"2024-05-04T07:50:32.575072+0000","last_clean":"2024-05-04T07:50:32.575072+0000","last_became_active":"2024-05-04T07:50:27.525248+0000","last_became_peered":"2024-05-04T07:50:27.525248+0000","last_unstale":"2024-05-04T07:50:32.575072+0000","last_undegraded":"2024-05-04T07:50:32.575072+0000","last_fullsized":"2024-05-04T07:50:32.575072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:28.619214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705230+0000","last_change":"2024-05-04T07:50:26.518937+0000","last_active":"2024-05-04T07:50:34.705230+0000","last_peered":"2024-05-04T07:50:34.705230+0000","last_clean":"2024-05-04T07:50:34.705230+0000","last_became_active":"2024-05-04T07:50:26.518493+0000","last_became_peered":"2024-05-04T07:50:26.518493+0000","last_unstale":"2024-05-04T07:50:34.705230+0000","last_undegraded":"2024-05-04T07:50:34.705230+0000","last_fullsized":"2024-05-04T07:50:34.705230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575567+0000","last_change":"2024-05-04T07:50:31.568993+0000","last_active":"2024-05-04T07:50:32.575567+0000","last_peered":"2024-05-04T07:50:32.575567+0000","last_clean":"2024-05-04T07:50:32.575567+0000","last_became_active":"2024-05-04T07:50:31.568477+0000","last_became_peered":"2024-05-04T07:50:31.568477+0000","last_unstale":"2024-05-04T07:50:32.575567+0000","last_undegraded":"2024-05-04T07:50:32.575567+0000","last_fullsized":"2024-05-04T07:50:32.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:23.224976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908175+0000","last_change":"2024-05-04T07:50:27.532480+0000","last_active":"2024-05-04T07:50:34.908175+0000","last_peered":"2024-05-04T07:50:34.908175+0000","last_clean":"2024-05-04T07:50:34.908175+0000","last_became_active":"2024-05-04T07:50:27.532194+0000","last_became_peered":"2024-05-04T07:50:27.532194+0000","last_unstale":"2024-05-04T07:50:34.908175+0000","last_undegraded":"2024-05-04T07:50:34.908175+0000","last_fullsized":"2024-05-04T07:50:34.908175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432284+0000","last_change":"2024-05-04T07:50:26.517065+0000","last_active":"2024-05-04T07:50:34.432284+0000","last_peered":"2024-05-04T07:50:34.432284+0000","last_clean":"2024-05-04T07:50:34.432284+0000","last_became_active":"2024-05-04T07:50:26.516714+0000","last_became_peered":"2024-05-04T07:50:26.516714+0000","last_unstale":"2024-05-04T07:50:34.432284+0000","last_undegraded":"2024-05-04T07:50:34.432284+0000","last_fullsized":"2024-05-04T07:50:34.432284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883217+0000","last_change":"2024-05-04T07:50:31.561005+0000","last_active":"2024-05-04T07:50:34.883217+0000","last_peered":"2024-05-04T07:50:34.883217+0000","last_clean":"2024-05-04T07:50:34.883217+0000","last_became_active":"2024-05-04T07:50:31.560530+0000","last_became_peered":"2024-05-04T07:50:31.560530+0000","last_unstale":"2024-05-04T07:50:34.883217+0000","last_undegraded":"2024-05-04T07:50:34.883217+0000","last_fullsized":"2024-05-04T07:50:34.883217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431967+0000","last_change":"2024-05-04T07:50:27.527644+0000","last_active":"2024-05-04T07:50:34.431967+0000","last_peered":"2024-05-04T07:50:34.431967+0000","last_clean":"2024-05-04T07:50:34.431967+0000","last_became_active":"2024-05-04T07:50:27.527144+0000","last_became_peered":"2024-05-04T07:50:27.527144+0000","last_unstale":"2024-05-04T07:50:34.431967+0000","last_undegraded":"2024-05-04T07:50:34.431967+0000","last_fullsized":"2024-05-04T07:50:34.431967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577526+0000","last_change":"2024-05-04T07:50:26.513482+0000","last_active":"2024-05-04T07:50:32.577526+0000","last_peered":"2024-05-04T07:50:32.577526+0000","last_clean":"2024-05-04T07:50:32.577526+0000","last_became_active":"2024-05-04T07:50:26.513184+0000","last_became_peered":"2024-05-04T07:50:26.513184+0000","last_unstale":"2024-05-04T07:50:32.577526+0000","last_undegraded":"2024-05-04T07:50:32.577526+0000","last_fullsized":"2024-05-04T07:50:32.577526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883725+0000","last_change":"2024-05-04T07:50:31.758024+0000","last_active":"2024-05-04T07:50:34.883725+0000","last_peered":"2024-05-04T07:50:34.883725+0000","last_clean":"2024-05-04T07:50:34.883725+0000","last_became_active":"2024-05-04T07:50:31.756399+0000","last_became_peered":"2024-05-04T07:50:31.756399+0000","last_unstale":"2024-05-04T07:50:34.883725+0000","last_undegraded":"2024-05-04T07:50:34.883725+0000","last_fullsized":"2024-05-04T07:50:34.883725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907003+0000","last_change":"2024-05-04T07:50:31.757980+0000","last_active":"2024-05-04T07:50:34.907003+0000","last_peered":"2024-05-04T07:50:34.907003+0000","last_clean":"2024-05-04T07:50:34.907003+0000","last_became_active":"2024-05-04T07:50:31.756577+0000","last_became_peered":"2024-05-04T07:50:31.756577+0000","last_unstale":"2024-05-04T07:50:34.907003+0000","last_undegraded":"2024-05-04T07:50:34.907003+0000","last_fullsized":"2024-05-04T07:50:34.907003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:37.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705484+0000","last_change":"2024-05-04T07:50:27.513707+0000","last_active":"2024-05-04T07:50:34.705484+0000","last_peered":"2024-05-04T07:50:34.705484+0000","last_clean":"2024-05-04T07:50:34.705484+0000","last_became_active":"2024-05-04T07:50:27.513407+0000","last_became_peered":"2024-05-04T07:50:27.513407+0000","last_unstale":"2024-05-04T07:50:34.705484+0000","last_undegraded":"2024-05-04T07:50:34.705484+0000","last_fullsized":"2024-05-04T07:50:34.705484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431437+0000","last_change":"2024-05-04T07:50:26.521863+0000","last_active":"2024-05-04T07:50:34.431437+0000","last_peered":"2024-05-04T07:50:34.431437+0000","last_clean":"2024-05-04T07:50:34.431437+0000","last_became_active":"2024-05-04T07:50:26.521362+0000","last_became_peered":"2024-05-04T07:50:26.521362+0000","last_unstale":"2024-05-04T07:50:34.431437+0000","last_undegraded":"2024-05-04T07:50:34.431437+0000","last_fullsized":"2024-05-04T07:50:34.431437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577533+0000","last_change":"2024-05-04T07:50:31.567080+0000","last_active":"2024-05-04T07:50:32.577533+0000","last_peered":"2024-05-04T07:50:32.577533+0000","last_clean":"2024-05-04T07:50:32.577533+0000","last_became_active":"2024-05-04T07:50:31.566643+0000","last_became_peered":"2024-05-04T07:50:31.566643+0000","last_unstale":"2024-05-04T07:50:32.577533+0000","last_undegraded":"2024-05-04T07:50:32.577533+0000","last_fullsized":"2024-05-04T07:50:32.577533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883291+0000","last_change":"2024-05-04T07:50:27.517785+0000","last_active":"2024-05-04T07:50:34.883291+0000","last_peered":"2024-05-04T07:50:34.883291+0000","last_clean":"2024-05-04T07:50:34.883291+0000","last_became_active":"2024-05-04T07:50:27.517532+0000","last_became_peered":"2024-05-04T07:50:27.517532+0000","last_unstale":"2024-05-04T07:50:34.883291+0000","last_undegraded":"2024-05-04T07:50:34.883291+0000","last_fullsized":"2024-05-04T07:50:34.883291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882248+0000","last_change":"2024-05-04T07:50:26.516109+0000","last_active":"2024-05-04T07:50:34.882248+0000","last_peered":"2024-05-04T07:50:34.882248+0000","last_clean":"2024-05-04T07:50:34.882248+0000","last_became_active":"2024-05-04T07:50:26.515518+0000","last_became_peered":"2024-05-04T07:50:26.515518+0000","last_unstale":"2024-05-04T07:50:34.882248+0000","last_undegraded":"2024-05-04T07:50:34.882248+0000","last_fullsized":"2024-05-04T07:50:34.882248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575304+0000","last_change":"2024-05-04T07:50:26.509275+0000","last_active":"2024-05-04T07:50:32.575304+0000","last_peered":"2024-05-04T07:50:32.575304+0000","last_clean":"2024-05-04T07:50:32.575304+0000","last_became_active":"2024-05-04T07:50:26.505492+0000","last_became_peered":"2024-05-04T07:50:26.505492+0000","last_unstale":"2024-05-04T07:50:32.575304+0000","last_undegraded":"2024-05-04T07:50:32.575304+0000","last_fullsized":"2024-05-04T07:50:32.575304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907512+0000","last_change":"2024-05-04T07:50:27.514230+0000","last_active":"2024-05-04T07:50:34.907512+0000","last_peered":"2024-05-04T07:50:34.907512+0000","last_clean":"2024-05-04T07:50:34.907512+0000","last_became_active":"2024-05-04T07:50:27.512993+0000","last_became_peered":"2024-05-04T07:50:27.512993+0000","last_unstale":"2024-05-04T07:50:34.907512+0000","last_undegraded":"2024-05-04T07:50:34.907512+0000","last_fullsized":"2024-05-04T07:50:34.907512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571374+0000","last_change":"2024-05-04T07:50:31.565560+0000","last_active":"2024-05-04T07:50:32.571374+0000","last_peered":"2024-05-04T07:50:32.571374+0000","last_clean":"2024-05-04T07:50:32.571374+0000","last_became_active":"2024-05-04T07:50:31.564371+0000","last_became_peered":"2024-05-04T07:50:31.564371+0000","last_unstale":"2024-05-04T07:50:32.571374+0000","last_undegraded":"2024-05-04T07:50:32.571374+0000","last_fullsized":"2024-05-04T07:50:32.571374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:16.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884400+0000","last_change":"2024-05-04T07:50:26.516509+0000","last_active":"2024-05-04T07:50:34.884400+0000","last_peered":"2024-05-04T07:50:34.884400+0000","last_clean":"2024-05-04T07:50:34.884400+0000","last_became_active":"2024-05-04T07:50:26.516120+0000","last_became_peered":"2024-05-04T07:50:26.516120+0000","last_unstale":"2024-05-04T07:50:34.884400+0000","last_undegraded":"2024-05-04T07:50:34.884400+0000","last_fullsized":"2024-05-04T07:50:34.884400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574616+0000","last_change":"2024-05-04T07:50:27.515095+0000","last_active":"2024-05-04T07:50:32.574616+0000","last_peered":"2024-05-04T07:50:32.574616+0000","last_clean":"2024-05-04T07:50:32.574616+0000","last_became_active":"2024-05-04T07:50:27.514715+0000","last_became_peered":"2024-05-04T07:50:27.514715+0000","last_unstale":"2024-05-04T07:50:32.574616+0000","last_undegraded":"2024-05-04T07:50:32.574616+0000","last_fullsized":"2024-05-04T07:50:32.574616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:19:00.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884950+0000","last_change":"2024-05-04T07:50:31.561861+0000","last_active":"2024-05-04T07:50:34.884950+0000","last_peered":"2024-05-04T07:50:34.884950+0000","last_clean":"2024-05-04T07:50:34.884950+0000","last_became_active":"2024-05-04T07:50:31.561513+0000","last_became_peered":"2024-05-04T07:50:31.561513+0000","last_unstale":"2024-05-04T07:50:34.884950+0000","last_undegraded":"2024-05-04T07:50:34.884950+0000","last_fullsized":"2024-05-04T07:50:34.884950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:47:50.794538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.572760+0000","last_change":"2024-05-04T07:50:27.518744+0000","last_active":"2024-05-04T07:50:32.572760+0000","last_peered":"2024-05-04T07:50:32.572760+0000","last_clean":"2024-05-04T07:50:32.572760+0000","last_became_active":"2024-05-04T07:50:27.518199+0000","last_became_peered":"2024-05-04T07:50:27.518199+0000","last_unstale":"2024-05-04T07:50:32.572760+0000","last_undegraded":"2024-05-04T07:50:32.572760+0000","last_fullsized":"2024-05-04T07:50:32.572760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570708+0000","last_change":"2024-05-04T07:50:27.523376+0000","last_active":"2024-05-04T07:50:32.570708+0000","last_peered":"2024-05-04T07:50:32.570708+0000","last_clean":"2024-05-04T07:50:32.570708+0000","last_became_active":"2024-05-04T07:50:27.523130+0000","last_became_peered":"2024-05-04T07:50:27.523130+0000","last_unstale":"2024-05-04T07:50:32.570708+0000","last_undegraded":"2024-05-04T07:50:32.570708+0000","last_fullsized":"2024-05-04T07:50:32.570708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431205+0000","last_change":"2024-05-04T07:50:27.530509+0000","last_active":"2024-05-04T07:50:34.431205+0000","last_peered":"2024-05-04T07:50:34.431205+0000","last_clean":"2024-05-04T07:50:34.431205+0000","last_became_active":"2024-05-04T07:50:27.515836+0000","last_became_peered":"2024-05-04T07:50:27.515836+0000","last_unstale":"2024-05-04T07:50:34.431205+0000","last_undegraded":"2024-05-04T07:50:34.431205+0000","last_fullsized":"2024-05-04T07:50:34.431205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907284+0000","last_change":"2024-05-04T07:50:27.514059+0000","last_active":"2024-05-04T07:50:34.907284+0000","last_peered":"2024-05-04T07:50:34.907284+0000","last_clean":"2024-05-04T07:50:34.907284+0000","last_became_active":"2024-05-04T07:50:27.513683+0000","last_became_peered":"2024-05-04T07:50:27.513683+0000","last_unstale":"2024-05-04T07:50:34.907284+0000","last_undegraded":"2024-05-04T07:50:34.907284+0000","last_fullsized":"2024-05-04T07:50:34.907284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884958+0000","last_change":"2024-05-04T07:50:27.512681+0000","last_active":"2024-05-04T07:50:34.884958+0000","last_peered":"2024-05-04T07:50:34.884958+0000","last_clean":"2024-05-04T07:50:34.884958+0000","last_became_active":"2024-05-04T07:50:27.512396+0000","last_became_peered":"2024-05-04T07:50:27.512396+0000","last_unstale":"2024-05-04T07:50:34.884958+0000","last_undegraded":"2024-05-04T07:50:34.884958+0000","last_fullsized":"2024-05-04T07:50:34.884958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706559+0000","last_change":"2024-05-04T07:50:27.513740+0000","last_active":"2024-05-04T07:50:34.706559+0000","last_peered":"2024-05-04T07:50:34.706559+0000","last_clean":"2024-05-04T07:50:34.706559+0000","last_became_active":"2024-05-04T07:50:27.513429+0000","last_became_peered":"2024-05-04T07:50:27.513429+0000","last_unstale":"2024-05-04T07:50:34.706559+0000","last_undegraded":"2024-05-04T07:50:34.706559+0000","last_fullsized":"2024-05-04T07:50:34.706559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578213+0000","last_change":"2024-05-04T07:50:27.523815+0000","last_active":"2024-05-04T07:50:32.578213+0000","last_peered":"2024-05-04T07:50:32.578213+0000","last_clean":"2024-05-04T07:50:32.578213+0000","last_became_active":"2024-05-04T07:50:27.520965+0000","last_became_peered":"2024-05-04T07:50:27.520965+0000","last_unstale":"2024-05-04T07:50:32.578213+0000","last_undegraded":"2024-05-04T07:50:32.578213+0000","last_fullsized":"2024-05-04T07:50:32.578213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885181+0000","last_change":"2024-05-04T07:50:27.512542+0000","last_active":"2024-05-04T07:50:34.885181+0000","last_peered":"2024-05-04T07:50:34.885181+0000","last_clean":"2024-05-04T07:50:34.885181+0000","last_became_active":"2024-05-04T07:50:27.511791+0000","last_became_peered":"2024-05-04T07:50:27.511791+0000","last_unstale":"2024-05-04T07:50:34.885181+0000","last_undegraded":"2024-05-04T07:50:34.885181+0000","last_fullsized":"2024-05-04T07:50:34.885181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431166+0000","last_change":"2024-05-04T07:50:27.525062+0000","last_active":"2024-05-04T07:50:34.431166+0000","last_peered":"2024-05-04T07:50:34.431166+0000","last_clean":"2024-05-04T07:50:34.431166+0000","last_became_active":"2024-05-04T07:50:27.523669+0000","last_became_peered":"2024-05-04T07:50:27.523669+0000","last_unstale":"2024-05-04T07:50:34.431166+0000","last_undegraded":"2024-05-04T07:50:34.431166+0000","last_fullsized":"2024-05-04T07:50:34.431166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883783+0000","last_change":"2024-05-04T07:50:27.529011+0000","last_active":"2024-05-04T07:50:34.883783+0000","last_peered":"2024-05-04T07:50:34.883783+0000","last_clean":"2024-05-04T07:50:34.883783+0000","last_became_active":"2024-05-04T07:50:27.518430+0000","last_became_peered":"2024-05-04T07:50:27.518430+0000","last_unstale":"2024-05-04T07:50:34.883783+0000","last_undegraded":"2024-05-04T07:50:34.883783+0000","last_fullsized":"2024-05-04T07:50:34.883783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431100+0000","last_change":"2024-05-04T07:50:27.535855+0000","last_active":"2024-05-04T07:50:34.431100+0000","last_peered":"2024-05-04T07:50:34.431100+0000","last_clean":"2024-05-04T07:50:34.431100+0000","last_became_active":"2024-05-04T07:50:27.535085+0000","last_became_peered":"2024-05-04T07:50:27.535085+0000","last_unstale":"2024-05-04T07:50:34.431100+0000","last_undegraded":"2024-05-04T07:50:34.431100+0000","last_fullsized":"2024-05-04T07:50:34.431100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906800+0000","last_change":"2024-05-04T07:50:27.517267+0000","last_active":"2024-05-04T07:50:34.906800+0000","last_peered":"2024-05-04T07:50:34.906800+0000","last_clean":"2024-05-04T07:50:34.906800+0000","last_became_active":"2024-05-04T07:50:27.516417+0000","last_became_peered":"2024-05-04T07:50:27.516417+0000","last_unstale":"2024-05-04T07:50:34.906800+0000","last_undegraded":"2024-05-04T07:50:34.906800+0000","last_fullsized":"2024-05-04T07:50:34.906800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576402+0000","last_change":"2024-05-04T07:50:27.532237+0000","last_active":"2024-05-04T07:50:32.576402+0000","last_peered":"2024-05-04T07:50:32.576402+0000","last_clean":"2024-05-04T07:50:32.576402+0000","last_became_active":"2024-05-04T07:50:27.530803+0000","last_became_peered":"2024-05-04T07:50:27.530803+0000","last_unstale":"2024-05-04T07:50:32.576402+0000","last_undegraded":"2024-05-04T07:50:32.576402+0000","last_fullsized":"2024-05-04T07:50:32.576402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677498+0000","last_change":"2024-05-04T07:50:27.521954+0000","last_active":"2024-05-04T07:50:34.677498+0000","last_peered":"2024-05-04T07:50:34.677498+0000","last_clean":"2024-05-04T07:50:34.677498+0000","last_became_active":"2024-05-04T07:50:27.521647+0000","last_became_peered":"2024-05-04T07:50:27.521647+0000","last_unstale":"2024-05-04T07:50:34.677498+0000","last_undegraded":"2024-05-04T07:50:34.677498+0000","last_fullsized":"2024-05-04T07:50:34.677498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571683+0000","last_change":"2024-05-04T07:50:27.514465+0000","last_active":"2024-05-04T07:50:32.571683+0000","last_peered":"2024-05-04T07:50:32.571683+0000","last_clean":"2024-05-04T07:50:32.571683+0000","last_became_active":"2024-05-04T07:50:27.514167+0000","last_became_peered":"2024-05-04T07:50:27.514167+0000","last_unstale":"2024-05-04T07:50:32.571683+0000","last_undegraded":"2024-05-04T07:50:32.571683+0000","last_fullsized":"2024-05-04T07:50:32.571683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:17.663860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432381+0000","last_change":"2024-05-04T07:50:27.532760+0000","last_active":"2024-05-04T07:50:34.432381+0000","last_peered":"2024-05-04T07:50:34.432381+0000","last_clean":"2024-05-04T07:50:34.432381+0000","last_became_active":"2024-05-04T07:50:27.532227+0000","last_became_peered":"2024-05-04T07:50:27.532227+0000","last_unstale":"2024-05-04T07:50:34.432381+0000","last_undegraded":"2024-05-04T07:50:34.432381+0000","last_fullsized":"2024-05-04T07:50:34.432381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430627+0000","last_change":"2024-05-04T07:50:27.526544+0000","last_active":"2024-05-04T07:50:34.430627+0000","last_peered":"2024-05-04T07:50:34.430627+0000","last_clean":"2024-05-04T07:50:34.430627+0000","last_became_active":"2024-05-04T07:50:27.523814+0000","last_became_peered":"2024-05-04T07:50:27.523814+0000","last_unstale":"2024-05-04T07:50:34.430627+0000","last_undegraded":"2024-05-04T07:50:34.430627+0000","last_fullsized":"2024-05-04T07:50:34.430627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705529+0000","last_change":"2024-05-04T07:50:27.520067+0000","last_active":"2024-05-04T07:50:34.705529+0000","last_peered":"2024-05-04T07:50:34.705529+0000","last_clean":"2024-05-04T07:50:34.705529+0000","last_became_active":"2024-05-04T07:50:27.519793+0000","last_became_peered":"2024-05-04T07:50:27.519793+0000","last_unstale":"2024-05-04T07:50:34.705529+0000","last_undegraded":"2024-05-04T07:50:34.705529+0000","last_fullsized":"2024-05-04T07:50:34.705529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906569+0000","last_change":"2024-05-04T07:50:27.519351+0000","last_active":"2024-05-04T07:50:34.906569+0000","last_peered":"2024-05-04T07:50:34.906569+0000","last_clean":"2024-05-04T07:50:34.906569+0000","last_became_active":"2024-05-04T07:50:27.519113+0000","last_became_peered":"2024-05-04T07:50:27.519113+0000","last_unstale":"2024-05-04T07:50:34.906569+0000","last_undegraded":"2024-05-04T07:50:34.906569+0000","last_fullsized":"2024-05-04T07:50:34.906569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:08.397148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884191+0000","last_change":"2024-05-04T07:50:27.512150+0000","last_active":"2024-05-04T07:50:34.884191+0000","last_peered":"2024-05-04T07:50:34.884191+0000","last_clean":"2024-05-04T07:50:34.884191+0000","last_became_active":"2024-05-04T07:50:27.511803+0000","last_became_peered":"2024-05-04T07:50:27.511803+0000","last_unstale":"2024-05-04T07:50:34.884191+0000","last_undegraded":"2024-05-04T07:50:34.884191+0000","last_fullsized":"2024-05-04T07:50:34.884191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574754+0000","last_change":"2024-05-04T07:50:27.515638+0000","last_active":"2024-05-04T07:50:32.574754+0000","last_peered":"2024-05-04T07:50:32.574754+0000","last_clean":"2024-05-04T07:50:32.574754+0000","last_became_active":"2024-05-04T07:50:27.515369+0000","last_became_peered":"2024-05-04T07:50:27.515369+0000","last_unstale":"2024-05-04T07:50:32.574754+0000","last_undegraded":"2024-05-04T07:50:32.574754+0000","last_fullsized":"2024-05-04T07:50:32.574754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577020+0000","last_change":"2024-05-04T07:50:27.526027+0000","last_active":"2024-05-04T07:50:32.577020+0000","last_peered":"2024-05-04T07:50:32.577020+0000","last_clean":"2024-05-04T07:50:32.577020+0000","last_became_active":"2024-05-04T07:50:27.525765+0000","last_became_peered":"2024-05-04T07:50:27.525765+0000","last_unstale":"2024-05-04T07:50:32.577020+0000","last_undegraded":"2024-05-04T07:50:32.577020+0000","last_fullsized":"2024-05-04T07:50:32.577020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578172+0000","last_change":"2024-05-04T07:50:27.528920+0000","last_active":"2024-05-04T07:50:32.578172+0000","last_peered":"2024-05-04T07:50:32.578172+0000","last_clean":"2024-05-04T07:50:32.578172+0000","last_became_active":"2024-05-04T07:50:27.528633+0000","last_became_peered":"2024-05-04T07:50:27.528633+0000","last_unstale":"2024-05-04T07:50:32.578172+0000","last_undegraded":"2024-05-04T07:50:32.578172+0000","last_fullsized":"2024-05-04T07:50:32.578172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677737+0000","last_change":"2024-05-04T07:50:27.539050+0000","last_active":"2024-05-04T07:50:34.677737+0000","last_peered":"2024-05-04T07:50:34.677737+0000","last_clean":"2024-05-04T07:50:34.677737+0000","last_became_active":"2024-05-04T07:50:27.538566+0000","last_became_peered":"2024-05-04T07:50:27.538566+0000","last_unstale":"2024-05-04T07:50:34.677737+0000","last_undegraded":"2024-05-04T07:50:34.677737+0000","last_fullsized":"2024-05-04T07:50:34.677737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:00.280798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882986+0000","last_change":"2024-05-04T07:50:27.530248+0000","last_active":"2024-05-04T07:50:34.882986+0000","last_peered":"2024-05-04T07:50:34.882986+0000","last_clean":"2024-05-04T07:50:34.882986+0000","last_became_active":"2024-05-04T07:50:27.529931+0000","last_became_peered":"2024-05-04T07:50:27.529931+0000","last_unstale":"2024-05-04T07:50:34.882986+0000","last_undegraded":"2024-05-04T07:50:34.882986+0000","last_fullsized":"2024-05-04T07:50:34.882986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676252+0000","last_change":"2024-05-04T07:50:27.529562+0000","last_active":"2024-05-04T07:50:34.676252+0000","last_peered":"2024-05-04T07:50:34.676252+0000","last_clean":"2024-05-04T07:50:34.676252+0000","last_became_active":"2024-05-04T07:50:27.526146+0000","last_became_peered":"2024-05-04T07:50:27.526146+0000","last_unstale":"2024-05-04T07:50:34.676252+0000","last_undegraded":"2024-05-04T07:50:34.676252+0000","last_fullsized":"2024-05-04T07:50:34.676252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430913+0000","last_change":"2024-05-04T07:50:27.535474+0000","last_active":"2024-05-04T07:50:34.430913+0000","last_peered":"2024-05-04T07:50:34.430913+0000","last_clean":"2024-05-04T07:50:34.430913+0000","last_became_active":"2024-05-04T07:50:27.534280+0000","last_became_peered":"2024-05-04T07:50:27.534280+0000","last_unstale":"2024-05-04T07:50:34.430913+0000","last_undegraded":"2024-05-04T07:50:34.430913+0000","last_fullsized":"2024-05-04T07:50:34.430913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676579+0000","last_change":"2024-05-04T07:50:27.535375+0000","last_active":"2024-05-04T07:50:34.676579+0000","last_peered":"2024-05-04T07:50:34.676579+0000","last_clean":"2024-05-04T07:50:34.676579+0000","last_became_active":"2024-05-04T07:50:27.535098+0000","last_became_peered":"2024-05-04T07:50:27.535098+0000","last_unstale":"2024-05-04T07:50:34.676579+0000","last_undegraded":"2024-05-04T07:50:34.676579+0000","last_fullsized":"2024-05-04T07:50:34.676579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431426+0000","last_change":"2024-05-04T07:50:27.524844+0000","last_active":"2024-05-04T07:50:34.431426+0000","last_peered":"2024-05-04T07:50:34.431426+0000","last_clean":"2024-05-04T07:50:34.431426+0000","last_became_active":"2024-05-04T07:50:27.516441+0000","last_became_peered":"2024-05-04T07:50:27.516441+0000","last_unstale":"2024-05-04T07:50:34.431426+0000","last_undegraded":"2024-05-04T07:50:34.431426+0000","last_fullsized":"2024-05-04T07:50:34.431426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907140+0000","last_change":"2024-05-04T07:50:27.510561+0000","last_active":"2024-05-04T07:50:34.907140+0000","last_peered":"2024-05-04T07:50:34.907140+0000","last_clean":"2024-05-04T07:50:34.907140+0000","last_became_active":"2024-05-04T07:50:27.510197+0000","last_became_peered":"2024-05-04T07:50:27.510197+0000","last_unstale":"2024-05-04T07:50:34.907140+0000","last_undegraded":"2024-05-04T07:50:34.907140+0000","last_fullsized":"2024-05-04T07:50:34.907140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707313+0000","last_change":"2024-05-04T07:50:27.520114+0000","last_active":"2024-05-04T07:50:34.707313+0000","last_peered":"2024-05-04T07:50:34.707313+0000","last_clean":"2024-05-04T07:50:34.707313+0000","last_became_active":"2024-05-04T07:50:27.518799+0000","last_became_peered":"2024-05-04T07:50:27.518799+0000","last_unstale":"2024-05-04T07:50:34.707313+0000","last_undegraded":"2024-05-04T07:50:34.707313+0000","last_fullsized":"2024-05-04T07:50:34.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677494+0000","last_change":"2024-05-04T07:50:27.521160+0000","last_active":"2024-05-04T07:50:34.677494+0000","last_peered":"2024-05-04T07:50:34.677494+0000","last_clean":"2024-05-04T07:50:34.677494+0000","last_became_active":"2024-05-04T07:50:27.520786+0000","last_became_peered":"2024-05-04T07:50:27.520786+0000","last_unstale":"2024-05-04T07:50:34.677494+0000","last_undegraded":"2024-05-04T07:50:34.677494+0000","last_fullsized":"2024-05-04T07:50:34.677494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:37.987648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:50:56.622 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:50:56.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.856+0000 7f215f200640 1 Processor -- start 2024-05-04T07:50:56.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.857+0000 7f215f200640 1 -- start start 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215f200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21600d3460 0x7f21600d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21600d3d80 con 0x7f21600b49e0 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215f200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f21600b2170 con 0x7f21600d3460 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f21600b2430 con 0x7f21600b1c60 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21600d3460 0x7f21600d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f21600d3460 0x7f21600d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33510/0 (socket says 172.21.15.136:33510) 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.858+0000 7f215de00640 1 -- 172.21.15.136:0/1733872551 learned_addr learned my addr 172.21.15.136:0/1733872551 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.859+0000 7f215d400640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.859+0000 7f215de00640 1 -- 172.21.15.136:0/1733872551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 msgr2=0x7f21600d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.859+0000 7f215de00640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600d59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.859+0000 7f215de00640 1 -- 172.21.15.136:0/1733872551 >> v1:172.21.15.142:6789/0 conn(0x7f21600b49e0 legacy=0x7f21600b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:56.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.859+0000 7f215de00640 1 -- 172.21.15.136:0/1733872551 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21600b2710 con 0x7f21600d3460 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.860+0000 7f215de00640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21600d3840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b7156b4ce29ae3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.860+0000 7f215ca00640 1 -- 172.21.15.136:0/1733872551 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150037070 con 0x7f21600d3460 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.860+0000 7f215ca00640 1 -- 172.21.15.136:0/1733872551 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150032440 con 0x7f21600d3460 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.860+0000 7f215ca00640 1 -- 172.21.15.136:0/1733872551 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150032810 con 0x7f21600d3460 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 -- 172.21.15.136:0/1733872551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 msgr2=0x7f21600d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21600d3840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2150009870 tx=0x7f215002a130 comp rx=0 tx=0).stop 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 -- 172.21.15.136:0/1733872551 shutdown_connections 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 --2- 172.21.15.136:0/1733872551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21600d3840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 -- 172.21.15.136:0/1733872551 >> 172.21.15.136:0/1733872551 conn(0x7f216009e370 msgr2=0x7f21600d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 -- 172.21.15.136:0/1733872551 shutdown_connections 2024-05-04T07:50:56.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.861+0000 7f215f200640 1 -- 172.21.15.136:0/1733872551 wait complete. 2024-05-04T07:50:56.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.862+0000 7f215f200640 1 Processor -- start 2024-05-04T07:50:56.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.862+0000 7f215f200640 1 -- start start 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21600b49e0 0x7f21601f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21600d5f00 con 0x7f21600d3460 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f21600b2cd0 con 0x7f21600b49e0 2024-05-04T07:50:56.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.863+0000 7f215f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f21600b4200 con 0x7f21600b1c60 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33518/0 (socket says 172.21.15.136:33518) 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 -- 172.21.15.136:0/2693464031 learned_addr learned my addr 172.21.15.136:0/2693464031 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215de00640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215d400640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21600b49e0 0x7f21601f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 -- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 msgr2=0x7f21600cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 -- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21600b49e0 msgr2=0x7f21601f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21600b49e0 0x7f21601f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 -- 172.21.15.136:0/2693464031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21600ba9e0 con 0x7f21600d3460 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.864+0000 7f215e800640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f215800b440 tx=0x7f215800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.865+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158015020 con 0x7f21600d3460 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.865+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2158011830 con 0x7f21600d3460 2024-05-04T07:50:56.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.865+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21600b86a0 con 0x7f21600d3460 2024-05-04T07:50:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.865+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158011c20 con 0x7f21600d3460 2024-05-04T07:50:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.865+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21600b8c60 con 0x7f21600d3460 2024-05-04T07:50:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.866+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21600b9140 con 0x7f21600d3460 2024-05-04T07:50:56.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.867+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2158018020 con 0x7f21600d3460 2024-05-04T07:50:56.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.868+0000 7f2156000640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 0x7f213c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:56.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.869+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f21580974e0 con 0x7f21600d3460 2024-05-04T07:50:56.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.869+0000 7f215de00640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 0x7f213c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:56.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.869+0000 7f215de00640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 0x7f213c078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2150034000 tx=0x7f215002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:56.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:56.873+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f215801f030 con 0x7f21600d3460 2024-05-04T07:50:57.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.060+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f216008f120 con 0x7f213c0762d0 2024-05-04T07:50:57.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.077+0000 7f2156000640 1 -- 172.21.15.136:0/2693464031 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f216008f120 con 0x7f213c0762d0 2024-05-04T07:50:57.080 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:57.084 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:50:57.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 msgr2=0x7f213c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 0x7f213c078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2150034000 tx=0x7f215002e000 comp rx=0 tx=0).stop 2024-05-04T07:50:57.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 msgr2=0x7f21601f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f215800b440 tx=0x7f215800b900 comp rx=0 tx=0).stop 2024-05-04T07:50:57.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 shutdown_connections 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f213c0762d0 0x7f213c078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21600d3460 0x7f21601f8f80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21600b49e0 0x7f21601f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 --2- 172.21.15.136:0/2693464031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21600b1c60 0x7f21600cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 >> 172.21.15.136:0/2693464031 conn(0x7f216009e370 msgr2=0x7f216006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 shutdown_connections 2024-05-04T07:50:57.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.085+0000 7f215f200640 1 -- 172.21.15.136:0/2693464031 wait complete. 2024-05-04T07:50:57.104 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-04T07:50:55.280226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004997"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908156+0000","last_change":"2024-05-04T07:50:26.511444+0000","last_active":"2024-05-04T07:50:34.908156+0000","last_peered":"2024-05-04T07:50:34.908156+0000","last_clean":"2024-05-04T07:50:34.908156+0000","last_became_active":"2024-05-04T07:50:26.511184+0000","last_became_peered":"2024-05-04T07:50:26.511184+0000","last_unstale":"2024-05-04T07:50:34.908156+0000","last_undegraded":"2024-05-04T07:50:34.908156+0000","last_fullsized":"2024-05-04T07:50:34.908156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885131+0000","last_change":"2024-05-04T07:50:27.511810+0000","last_active":"2024-05-04T07:50:34.885131+0000","last_peered":"2024-05-04T07:50:34.885131+0000","last_clean":"2024-05-04T07:50:34.885131+0000","last_became_active":"2024-05-04T07:50:27.511405+0000","last_became_peered":"2024-05-04T07:50:27.511405+0000","last_unstale":"2024-05-04T07:50:34.885131+0000","last_undegraded":"2024-05-04T07:50:34.885131+0000","last_fullsized":"2024-05-04T07:50:34.885131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883149+0000","last_change":"2024-05-04T07:50:31.757139+0000","last_active":"2024-05-04T07:50:34.883149+0000","last_peered":"2024-05-04T07:50:34.883149+0000","last_clean":"2024-05-04T07:50:34.883149+0000","last_became_active":"2024-05-04T07:50:31.756650+0000","last_became_peered":"2024-05-04T07:50:31.756650+0000","last_unstale":"2024-05-04T07:50:34.883149+0000","last_undegraded":"2024-05-04T07:50:34.883149+0000","last_fullsized":"2024-05-04T07:50:34.883149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885411+0000","last_change":"2024-05-04T07:50:26.515716+0000","last_active":"2024-05-04T07:50:34.885411+0000","last_peered":"2024-05-04T07:50:34.885411+0000","last_clean":"2024-05-04T07:50:34.885411+0000","last_became_active":"2024-05-04T07:50:26.515369+0000","last_became_peered":"2024-05-04T07:50:26.515369+0000","last_unstale":"2024-05-04T07:50:34.885411+0000","last_undegraded":"2024-05-04T07:50:34.885411+0000","last_fullsized":"2024-05-04T07:50:34.885411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907863+0000","last_change":"2024-05-04T07:50:27.532568+0000","last_active":"2024-05-04T07:50:34.907863+0000","last_peered":"2024-05-04T07:50:34.907863+0000","last_clean":"2024-05-04T07:50:34.907863+0000","last_became_active":"2024-05-04T07:50:27.532259+0000","last_became_peered":"2024-05-04T07:50:27.532259+0000","last_unstale":"2024-05-04T07:50:34.907863+0000","last_undegraded":"2024-05-04T07:50:34.907863+0000","last_fullsized":"2024-05-04T07:50:34.907863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574294+0000","last_change":"2024-05-04T07:50:31.571444+0000","last_active":"2024-05-04T07:50:32.574294+0000","last_peered":"2024-05-04T07:50:32.574294+0000","last_clean":"2024-05-04T07:50:32.574294+0000","last_became_active":"2024-05-04T07:50:31.570161+0000","last_became_peered":"2024-05-04T07:50:31.570161+0000","last_unstale":"2024-05-04T07:50:32.574294+0000","last_undegraded":"2024-05-04T07:50:32.574294+0000","last_fullsized":"2024-05-04T07:50:32.574294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:20.105139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.520446+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.519707+0000","last_became_peered":"2024-05-04T07:50:26.519707+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:04:46.769896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431704+0000","last_change":"2024-05-04T07:50:27.531288+0000","last_active":"2024-05-04T07:50:34.431704+0000","last_peered":"2024-05-04T07:50:34.431704+0000","last_clean":"2024-05-04T07:50:34.431704+0000","last_became_active":"2024-05-04T07:50:27.531005+0000","last_became_peered":"2024-05-04T07:50:27.531005+0000","last_unstale":"2024-05-04T07:50:34.431704+0000","last_undegraded":"2024-05-04T07:50:34.431704+0000","last_fullsized":"2024-05-04T07:50:34.431704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575189+0000","last_change":"2024-05-04T07:50:31.568998+0000","last_active":"2024-05-04T07:50:32.575189+0000","last_peered":"2024-05-04T07:50:32.575189+0000","last_clean":"2024-05-04T07:50:32.575189+0000","last_became_active":"2024-05-04T07:50:31.568443+0000","last_became_peered":"2024-05-04T07:50:31.568443+0000","last_unstale":"2024-05-04T07:50:32.575189+0000","last_undegraded":"2024-05-04T07:50:32.575189+0000","last_fullsized":"2024-05-04T07:50:32.575189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:11.154767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675279+0000","last_change":"2024-05-04T07:50:26.523596+0000","last_active":"2024-05-04T07:50:34.675279+0000","last_peered":"2024-05-04T07:50:34.675279+0000","last_clean":"2024-05-04T07:50:34.675279+0000","last_became_active":"2024-05-04T07:50:26.523247+0000","last_became_peered":"2024-05-04T07:50:26.523247+0000","last_unstale":"2024-05-04T07:50:34.675279+0000","last_undegraded":"2024-05-04T07:50:34.675279+0000","last_fullsized":"2024-05-04T07:50:34.675279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431910+0000","last_change":"2024-05-04T07:50:27.527272+0000","last_active":"2024-05-04T07:50:34.431910+0000","last_peered":"2024-05-04T07:50:34.431910+0000","last_clean":"2024-05-04T07:50:34.431910+0000","last_became_active":"2024-05-04T07:50:27.526746+0000","last_became_peered":"2024-05-04T07:50:27.526746+0000","last_unstale":"2024-05-04T07:50:34.431910+0000","last_undegraded":"2024-05-04T07:50:34.431910+0000","last_fullsized":"2024-05-04T07:50:34.431910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574307+0000","last_change":"2024-05-04T07:50:31.557824+0000","last_active":"2024-05-04T07:50:32.574307+0000","last_peered":"2024-05-04T07:50:32.574307+0000","last_clean":"2024-05-04T07:50:32.574307+0000","last_became_active":"2024-05-04T07:50:31.557272+0000","last_became_peered":"2024-05-04T07:50:31.557272+0000","last_unstale":"2024-05-04T07:50:32.574307+0000","last_undegraded":"2024-05-04T07:50:32.574307+0000","last_fullsized":"2024-05-04T07:50:32.574307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:15.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574756+0000","last_change":"2024-05-04T07:50:27.530293+0000","last_active":"2024-05-04T07:50:32.574756+0000","last_peered":"2024-05-04T07:50:32.574756+0000","last_clean":"2024-05-04T07:50:32.574756+0000","last_became_active":"2024-05-04T07:50:27.529984+0000","last_became_peered":"2024-05-04T07:50:27.529984+0000","last_unstale":"2024-05-04T07:50:32.574756+0000","last_undegraded":"2024-05-04T07:50:32.574756+0000","last_fullsized":"2024-05-04T07:50:32.574756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675329+0000","last_change":"2024-05-04T07:50:26.521571+0000","last_active":"2024-05-04T07:50:34.675329+0000","last_peered":"2024-05-04T07:50:34.675329+0000","last_clean":"2024-05-04T07:50:34.675329+0000","last_became_active":"2024-05-04T07:50:26.521188+0000","last_became_peered":"2024-05-04T07:50:26.521188+0000","last_unstale":"2024-05-04T07:50:34.675329+0000","last_undegraded":"2024-05-04T07:50:34.675329+0000","last_fullsized":"2024-05-04T07:50:34.675329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:11.871066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576679+0000","last_change":"2024-05-04T07:50:31.570676+0000","last_active":"2024-05-04T07:50:32.576679+0000","last_peered":"2024-05-04T07:50:32.576679+0000","last_clean":"2024-05-04T07:50:32.576679+0000","last_became_active":"2024-05-04T07:50:31.570276+0000","last_became_peered":"2024-05-04T07:50:31.570276+0000","last_unstale":"2024-05-04T07:50:32.576679+0000","last_undegraded":"2024-05-04T07:50:32.576679+0000","last_fullsized":"2024-05-04T07:50:32.576679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884190+0000","last_change":"2024-05-04T07:50:27.532074+0000","last_active":"2024-05-04T07:50:34.884190+0000","last_peered":"2024-05-04T07:50:34.884190+0000","last_clean":"2024-05-04T07:50:34.884190+0000","last_became_active":"2024-05-04T07:50:27.529720+0000","last_became_peered":"2024-05-04T07:50:27.529720+0000","last_unstale":"2024-05-04T07:50:34.884190+0000","last_undegraded":"2024-05-04T07:50:34.884190+0000","last_fullsized":"2024-05-04T07:50:34.884190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706867+0000","last_change":"2024-05-04T07:50:26.523351+0000","last_active":"2024-05-04T07:50:34.706867+0000","last_peered":"2024-05-04T07:50:34.706867+0000","last_clean":"2024-05-04T07:50:34.706867+0000","last_became_active":"2024-05-04T07:50:26.522661+0000","last_became_peered":"2024-05-04T07:50:26.522661+0000","last_unstale":"2024-05-04T07:50:34.706867+0000","last_undegraded":"2024-05-04T07:50:34.706867+0000","last_fullsized":"2024-05-04T07:50:34.706867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574356+0000","last_change":"2024-05-04T07:50:31.569229+0000","last_active":"2024-05-04T07:50:32.574356+0000","last_peered":"2024-05-04T07:50:32.574356+0000","last_clean":"2024-05-04T07:50:32.574356+0000","last_became_active":"2024-05-04T07:50:31.568499+0000","last_became_peered":"2024-05-04T07:50:31.568499+0000","last_unstale":"2024-05-04T07:50:32.574356+0000","last_undegraded":"2024-05-04T07:50:32.574356+0000","last_fullsized":"2024-05-04T07:50:32.574356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:01.830913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883443+0000","last_change":"2024-05-04T07:50:27.528537+0000","last_active":"2024-05-04T07:50:34.883443+0000","last_peered":"2024-05-04T07:50:34.883443+0000","last_clean":"2024-05-04T07:50:34.883443+0000","last_became_active":"2024-05-04T07:50:27.528071+0000","last_became_peered":"2024-05-04T07:50:27.528071+0000","last_unstale":"2024-05-04T07:50:34.883443+0000","last_undegraded":"2024-05-04T07:50:34.883443+0000","last_fullsized":"2024-05-04T07:50:34.883443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705613+0000","last_change":"2024-05-04T07:50:26.509143+0000","last_active":"2024-05-04T07:50:34.705613+0000","last_peered":"2024-05-04T07:50:34.705613+0000","last_clean":"2024-05-04T07:50:34.705613+0000","last_became_active":"2024-05-04T07:50:26.508476+0000","last_became_peered":"2024-05-04T07:50:26.508476+0000","last_unstale":"2024-05-04T07:50:34.705613+0000","last_undegraded":"2024-05-04T07:50:34.705613+0000","last_fullsized":"2024-05-04T07:50:34.705613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707315+0000","last_change":"2024-05-04T07:50:31.751464+0000","last_active":"2024-05-04T07:50:34.707315+0000","last_peered":"2024-05-04T07:50:34.707315+0000","last_clean":"2024-05-04T07:50:34.707315+0000","last_became_active":"2024-05-04T07:50:31.751012+0000","last_became_peered":"2024-05-04T07:50:31.751012+0000","last_unstale":"2024-05-04T07:50:34.707315+0000","last_undegraded":"2024-05-04T07:50:34.707315+0000","last_fullsized":"2024-05-04T07:50:34.707315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:53.275810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576462+0000","last_change":"2024-05-04T07:50:27.503181+0000","last_active":"2024-05-04T07:50:32.576462+0000","last_peered":"2024-05-04T07:50:32.576462+0000","last_clean":"2024-05-04T07:50:32.576462+0000","last_became_active":"2024-05-04T07:50:27.502878+0000","last_became_peered":"2024-05-04T07:50:27.502878+0000","last_unstale":"2024-05-04T07:50:32.576462+0000","last_undegraded":"2024-05-04T07:50:32.576462+0000","last_fullsized":"2024-05-04T07:50:32.576462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:33.061709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675823+0000","last_change":"2024-05-04T07:50:26.516424+0000","last_active":"2024-05-04T07:50:34.675823+0000","last_peered":"2024-05-04T07:50:34.675823+0000","last_clean":"2024-05-04T07:50:34.675823+0000","last_became_active":"2024-05-04T07:50:26.515804+0000","last_became_peered":"2024-05-04T07:50:26.515804+0000","last_unstale":"2024-05-04T07:50:34.675823+0000","last_undegraded":"2024-05-04T07:50:34.675823+0000","last_fullsized":"2024-05-04T07:50:34.675823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:27.606155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576592+0000","last_change":"2024-05-04T07:50:31.571745+0000","last_active":"2024-05-04T07:50:32.576592+0000","last_peered":"2024-05-04T07:50:32.576592+0000","last_clean":"2024-05-04T07:50:32.576592+0000","last_became_active":"2024-05-04T07:50:31.571236+0000","last_became_peered":"2024-05-04T07:50:31.571236+0000","last_unstale":"2024-05-04T07:50:32.576592+0000","last_undegraded":"2024-05-04T07:50:32.576592+0000","last_fullsized":"2024-05-04T07:50:32.576592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907548+0000","last_change":"2024-05-04T07:50:27.520723+0000","last_active":"2024-05-04T07:50:34.907548+0000","last_peered":"2024-05-04T07:50:34.907548+0000","last_clean":"2024-05-04T07:50:34.907548+0000","last_became_active":"2024-05-04T07:50:27.520401+0000","last_became_peered":"2024-05-04T07:50:27.520401+0000","last_unstale":"2024-05-04T07:50:34.907548+0000","last_undegraded":"2024-05-04T07:50:34.907548+0000","last_fullsized":"2024-05-04T07:50:34.907548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577779+0000","last_change":"2024-05-04T07:50:26.508044+0000","last_active":"2024-05-04T07:50:32.577779+0000","last_peered":"2024-05-04T07:50:32.577779+0000","last_clean":"2024-05-04T07:50:32.577779+0000","last_became_active":"2024-05-04T07:50:26.507669+0000","last_became_peered":"2024-05-04T07:50:26.507669+0000","last_unstale":"2024-05-04T07:50:32.577779+0000","last_undegraded":"2024-05-04T07:50:32.577779+0000","last_fullsized":"2024-05-04T07:50:32.577779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576003+0000","last_change":"2024-05-04T07:50:31.751252+0000","last_active":"2024-05-04T07:50:32.576003+0000","last_peered":"2024-05-04T07:50:32.576003+0000","last_clean":"2024-05-04T07:50:32.576003+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:32.576003+0000","last_undegraded":"2024-05-04T07:50:32.576003+0000","last_fullsized":"2024-05-04T07:50:32.576003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885325+0000","last_change":"2024-05-04T07:50:27.529761+0000","last_active":"2024-05-04T07:50:34.885325+0000","last_peered":"2024-05-04T07:50:34.885325+0000","last_clean":"2024-05-04T07:50:34.885325+0000","last_became_active":"2024-05-04T07:50:27.529312+0000","last_became_peered":"2024-05-04T07:50:27.529312+0000","last_unstale":"2024-05-04T07:50:34.885325+0000","last_undegraded":"2024-05-04T07:50:34.885325+0000","last_fullsized":"2024-05-04T07:50:34.885325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705096+0000","last_change":"2024-05-04T07:50:26.510946+0000","last_active":"2024-05-04T07:50:34.705096+0000","last_peered":"2024-05-04T07:50:34.705096+0000","last_clean":"2024-05-04T07:50:34.705096+0000","last_became_active":"2024-05-04T07:50:26.510126+0000","last_became_peered":"2024-05-04T07:50:26.510126+0000","last_unstale":"2024-05-04T07:50:34.705096+0000","last_undegraded":"2024-05-04T07:50:34.705096+0000","last_fullsized":"2024-05-04T07:50:34.705096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:31.589167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882789+0000","last_change":"2024-05-04T07:50:31.748699+0000","last_active":"2024-05-04T07:50:34.882789+0000","last_peered":"2024-05-04T07:50:34.882789+0000","last_clean":"2024-05-04T07:50:34.882789+0000","last_became_active":"2024-05-04T07:50:31.748089+0000","last_became_peered":"2024-05-04T07:50:31.748089+0000","last_unstale":"2024-05-04T07:50:34.882789+0000","last_undegraded":"2024-05-04T07:50:34.882789+0000","last_fullsized":"2024-05-04T07:50:34.882789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706580+0000","last_change":"2024-05-04T07:50:27.517196+0000","last_active":"2024-05-04T07:50:34.706580+0000","last_peered":"2024-05-04T07:50:34.706580+0000","last_clean":"2024-05-04T07:50:34.706580+0000","last_became_active":"2024-05-04T07:50:27.516775+0000","last_became_peered":"2024-05-04T07:50:27.516775+0000","last_unstale":"2024-05-04T07:50:34.706580+0000","last_undegraded":"2024-05-04T07:50:34.706580+0000","last_fullsized":"2024-05-04T07:50:34.706580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677514+0000","last_change":"2024-05-04T07:50:26.522492+0000","last_active":"2024-05-04T07:50:34.677514+0000","last_peered":"2024-05-04T07:50:34.677514+0000","last_clean":"2024-05-04T07:50:34.677514+0000","last_became_active":"2024-05-04T07:50:26.522237+0000","last_became_peered":"2024-05-04T07:50:26.522237+0000","last_unstale":"2024-05-04T07:50:34.677514+0000","last_undegraded":"2024-05-04T07:50:34.677514+0000","last_fullsized":"2024-05-04T07:50:34.677514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:49:19.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907032+0000","last_change":"2024-05-04T07:50:31.747060+0000","last_active":"2024-05-04T07:50:34.907032+0000","last_peered":"2024-05-04T07:50:34.907032+0000","last_clean":"2024-05-04T07:50:34.907032+0000","last_became_active":"2024-05-04T07:50:31.746470+0000","last_became_peered":"2024-05-04T07:50:31.746470+0000","last_unstale":"2024-05-04T07:50:34.907032+0000","last_undegraded":"2024-05-04T07:50:34.907032+0000","last_fullsized":"2024-05-04T07:50:34.907032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432324+0000","last_change":"2024-05-04T07:50:27.525057+0000","last_active":"2024-05-04T07:50:34.432324+0000","last_peered":"2024-05-04T07:50:34.432324+0000","last_clean":"2024-05-04T07:50:34.432324+0000","last_became_active":"2024-05-04T07:50:27.518656+0000","last_became_peered":"2024-05-04T07:50:27.518656+0000","last_unstale":"2024-05-04T07:50:34.432324+0000","last_undegraded":"2024-05-04T07:50:34.432324+0000","last_fullsized":"2024-05-04T07:50:34.432324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706680+0000","last_change":"2024-05-04T07:50:26.509525+0000","last_active":"2024-05-04T07:50:34.706680+0000","last_peered":"2024-05-04T07:50:34.706680+0000","last_clean":"2024-05-04T07:50:34.706680+0000","last_became_active":"2024-05-04T07:50:26.509234+0000","last_became_peered":"2024-05-04T07:50:26.509234+0000","last_unstale":"2024-05-04T07:50:34.706680+0000","last_undegraded":"2024-05-04T07:50:34.706680+0000","last_fullsized":"2024-05-04T07:50:34.706680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705890+0000","last_change":"2024-05-04T07:50:31.564531+0000","last_active":"2024-05-04T07:50:34.705890+0000","last_peered":"2024-05-04T07:50:34.705890+0000","last_clean":"2024-05-04T07:50:34.705890+0000","last_became_active":"2024-05-04T07:50:31.563731+0000","last_became_peered":"2024-05-04T07:50:31.563731+0000","last_unstale":"2024-05-04T07:50:34.705890+0000","last_undegraded":"2024-05-04T07:50:34.705890+0000","last_fullsized":"2024-05-04T07:50:34.705890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575993+0000","last_change":"2024-05-04T07:50:27.534533+0000","last_active":"2024-05-04T07:50:32.575993+0000","last_peered":"2024-05-04T07:50:32.575993+0000","last_clean":"2024-05-04T07:50:32.575993+0000","last_became_active":"2024-05-04T07:50:27.530233+0000","last_became_peered":"2024-05-04T07:50:27.530233+0000","last_unstale":"2024-05-04T07:50:32.575993+0000","last_undegraded":"2024-05-04T07:50:32.575993+0000","last_fullsized":"2024-05-04T07:50:32.575993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:14:32.602226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431458+0000","last_change":"2024-05-04T07:50:26.519163+0000","last_active":"2024-05-04T07:50:34.431458+0000","last_peered":"2024-05-04T07:50:34.431458+0000","last_clean":"2024-05-04T07:50:34.431458+0000","last_became_active":"2024-05-04T07:50:26.518842+0000","last_became_peered":"2024-05-04T07:50:26.518842+0000","last_unstale":"2024-05-04T07:50:34.431458+0000","last_undegraded":"2024-05-04T07:50:34.431458+0000","last_fullsized":"2024-05-04T07:50:34.431458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:37.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706475+0000","last_change":"2024-05-04T07:50:31.568404+0000","last_active":"2024-05-04T07:50:34.706475+0000","last_peered":"2024-05-04T07:50:34.706475+0000","last_clean":"2024-05-04T07:50:34.706475+0000","last_became_active":"2024-05-04T07:50:31.568002+0000","last_became_peered":"2024-05-04T07:50:31.568002+0000","last_unstale":"2024-05-04T07:50:34.706475+0000","last_undegraded":"2024-05-04T07:50:34.706475+0000","last_fullsized":"2024-05-04T07:50:34.706475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:04.332675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706056+0000","last_change":"2024-05-04T07:50:27.514675+0000","last_active":"2024-05-04T07:50:34.706056+0000","last_peered":"2024-05-04T07:50:34.706056+0000","last_clean":"2024-05-04T07:50:34.706056+0000","last_became_active":"2024-05-04T07:50:27.514210+0000","last_became_peered":"2024-05-04T07:50:27.514210+0000","last_unstale":"2024-05-04T07:50:34.706056+0000","last_undegraded":"2024-05-04T07:50:34.706056+0000","last_fullsized":"2024-05-04T07:50:34.706056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571018+0000","last_change":"2024-05-04T07:50:26.519658+0000","last_active":"2024-05-04T07:50:32.571018+0000","last_peered":"2024-05-04T07:50:32.571018+0000","last_clean":"2024-05-04T07:50:32.571018+0000","last_became_active":"2024-05-04T07:50:26.519341+0000","last_became_peered":"2024-05-04T07:50:26.519341+0000","last_unstale":"2024-05-04T07:50:32.571018+0000","last_undegraded":"2024-05-04T07:50:32.571018+0000","last_fullsized":"2024-05-04T07:50:32.571018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707413+0000","last_change":"2024-05-04T07:50:31.573798+0000","last_active":"2024-05-04T07:50:34.707413+0000","last_peered":"2024-05-04T07:50:34.707413+0000","last_clean":"2024-05-04T07:50:34.707413+0000","last_became_active":"2024-05-04T07:50:31.573273+0000","last_became_peered":"2024-05-04T07:50:31.573273+0000","last_unstale":"2024-05-04T07:50:34.707413+0000","last_undegraded":"2024-05-04T07:50:34.707413+0000","last_fullsized":"2024-05-04T07:50:34.707413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906075+0000","last_change":"2024-05-04T07:50:27.524360+0000","last_active":"2024-05-04T07:50:34.906075+0000","last_peered":"2024-05-04T07:50:34.906075+0000","last_clean":"2024-05-04T07:50:34.906075+0000","last_became_active":"2024-05-04T07:50:27.524070+0000","last_became_peered":"2024-05-04T07:50:27.524070+0000","last_unstale":"2024-05-04T07:50:34.906075+0000","last_undegraded":"2024-05-04T07:50:34.906075+0000","last_fullsized":"2024-05-04T07:50:34.906075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:12.884125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.675820+0000","last_change":"2024-05-04T07:50:26.516657+0000","last_active":"2024-05-04T07:50:34.675820+0000","last_peered":"2024-05-04T07:50:34.675820+0000","last_clean":"2024-05-04T07:50:34.675820+0000","last_became_active":"2024-05-04T07:50:26.516141+0000","last_became_peered":"2024-05-04T07:50:26.516141+0000","last_unstale":"2024-05-04T07:50:34.675820+0000","last_undegraded":"2024-05-04T07:50:34.675820+0000","last_fullsized":"2024-05-04T07:50:34.675820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907557+0000","last_change":"2024-05-04T07:50:31.756700+0000","last_active":"2024-05-04T07:50:34.907557+0000","last_peered":"2024-05-04T07:50:34.907557+0000","last_clean":"2024-05-04T07:50:34.907557+0000","last_became_active":"2024-05-04T07:50:31.756170+0000","last_became_peered":"2024-05-04T07:50:31.756170+0000","last_unstale":"2024-05-04T07:50:34.907557+0000","last_undegraded":"2024-05-04T07:50:34.907557+0000","last_fullsized":"2024-05-04T07:50:34.907557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884037+0000","last_change":"2024-05-04T07:50:27.539831+0000","last_active":"2024-05-04T07:50:34.884037+0000","last_peered":"2024-05-04T07:50:34.884037+0000","last_clean":"2024-05-04T07:50:34.884037+0000","last_became_active":"2024-05-04T07:50:27.539289+0000","last_became_peered":"2024-05-04T07:50:27.539289+0000","last_unstale":"2024-05-04T07:50:34.884037+0000","last_undegraded":"2024-05-04T07:50:34.884037+0000","last_fullsized":"2024-05-04T07:50:34.884037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431173+0000","last_change":"2024-05-04T07:50:26.513428+0000","last_active":"2024-05-04T07:50:34.431173+0000","last_peered":"2024-05-04T07:50:34.431173+0000","last_clean":"2024-05-04T07:50:34.431173+0000","last_became_active":"2024-05-04T07:50:26.512961+0000","last_became_peered":"2024-05-04T07:50:26.512961+0000","last_unstale":"2024-05-04T07:50:34.431173+0000","last_undegraded":"2024-05-04T07:50:34.431173+0000","last_fullsized":"2024-05-04T07:50:34.431173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676160+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:50:34.676160+0000","last_peered":"2024-05-04T07:50:34.676160+0000","last_clean":"2024-05-04T07:50:34.676160+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:50:34.676160+0000","last_undegraded":"2024-05-04T07:50:34.676160+0000","last_fullsized":"2024-05-04T07:50:34.676160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576262+0000","last_change":"2024-05-04T07:50:31.754509+0000","last_active":"2024-05-04T07:50:32.576262+0000","last_peered":"2024-05-04T07:50:32.576262+0000","last_clean":"2024-05-04T07:50:32.576262+0000","last_became_active":"2024-05-04T07:50:31.751388+0000","last_became_peered":"2024-05-04T07:50:31.751388+0000","last_unstale":"2024-05-04T07:50:32.576262+0000","last_undegraded":"2024-05-04T07:50:32.576262+0000","last_fullsized":"2024-05-04T07:50:32.576262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:13:04.020791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677129+0000","last_change":"2024-05-04T07:50:27.526484+0000","last_active":"2024-05-04T07:50:34.677129+0000","last_peered":"2024-05-04T07:50:34.677129+0000","last_clean":"2024-05-04T07:50:34.677129+0000","last_became_active":"2024-05-04T07:50:27.526184+0000","last_became_peered":"2024-05-04T07:50:27.526184+0000","last_unstale":"2024-05-04T07:50:34.677129+0000","last_undegraded":"2024-05-04T07:50:34.677129+0000","last_fullsized":"2024-05-04T07:50:34.677129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571639+0000","last_change":"2024-05-04T07:50:26.511552+0000","last_active":"2024-05-04T07:50:32.571639+0000","last_peered":"2024-05-04T07:50:32.571639+0000","last_clean":"2024-05-04T07:50:32.571639+0000","last_became_active":"2024-05-04T07:50:26.510510+0000","last_became_peered":"2024-05-04T07:50:26.510510+0000","last_unstale":"2024-05-04T07:50:32.571639+0000","last_undegraded":"2024-05-04T07:50:32.571639+0000","last_fullsized":"2024-05-04T07:50:32.571639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573035+0000","last_change":"2024-05-04T07:50:31.749615+0000","last_active":"2024-05-04T07:50:32.573035+0000","last_peered":"2024-05-04T07:50:32.573035+0000","last_clean":"2024-05-04T07:50:32.573035+0000","last_became_active":"2024-05-04T07:50:31.748418+0000","last_became_peered":"2024-05-04T07:50:31.748418+0000","last_unstale":"2024-05-04T07:50:32.573035+0000","last_undegraded":"2024-05-04T07:50:32.573035+0000","last_fullsized":"2024-05-04T07:50:32.573035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:03.446762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431745+0000","last_change":"2024-05-04T07:50:27.533824+0000","last_active":"2024-05-04T07:50:34.431745+0000","last_peered":"2024-05-04T07:50:34.431745+0000","last_clean":"2024-05-04T07:50:34.431745+0000","last_became_active":"2024-05-04T07:50:27.533561+0000","last_became_peered":"2024-05-04T07:50:27.533561+0000","last_unstale":"2024-05-04T07:50:34.431745+0000","last_undegraded":"2024-05-04T07:50:34.431745+0000","last_fullsized":"2024-05-04T07:50:34.431745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705144+0000","last_change":"2024-05-04T07:50:26.514911+0000","last_active":"2024-05-04T07:50:34.705144+0000","last_peered":"2024-05-04T07:50:34.705144+0000","last_clean":"2024-05-04T07:50:34.705144+0000","last_became_active":"2024-05-04T07:50:26.514615+0000","last_became_peered":"2024-05-04T07:50:26.514615+0000","last_unstale":"2024-05-04T07:50:34.705144+0000","last_undegraded":"2024-05-04T07:50:34.705144+0000","last_fullsized":"2024-05-04T07:50:34.705144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:16.650801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907253+0000","last_change":"2024-05-04T07:50:31.568892+0000","last_active":"2024-05-04T07:50:34.907253+0000","last_peered":"2024-05-04T07:50:34.907253+0000","last_clean":"2024-05-04T07:50:34.907253+0000","last_became_active":"2024-05-04T07:50:31.568427+0000","last_became_peered":"2024-05-04T07:50:31.568427+0000","last_unstale":"2024-05-04T07:50:34.907253+0000","last_undegraded":"2024-05-04T07:50:34.907253+0000","last_fullsized":"2024-05-04T07:50:34.907253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:52.184696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677795+0000","last_change":"2024-05-04T07:50:27.537511+0000","last_active":"2024-05-04T07:50:34.677795+0000","last_peered":"2024-05-04T07:50:34.677795+0000","last_clean":"2024-05-04T07:50:34.677795+0000","last_became_active":"2024-05-04T07:50:27.536076+0000","last_became_peered":"2024-05-04T07:50:27.536076+0000","last_unstale":"2024-05-04T07:50:34.677795+0000","last_undegraded":"2024-05-04T07:50:34.677795+0000","last_fullsized":"2024-05-04T07:50:34.677795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:45:49.223933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571866+0000","last_change":"2024-05-04T07:50:26.517157+0000","last_active":"2024-05-04T07:50:32.571866+0000","last_peered":"2024-05-04T07:50:32.571866+0000","last_clean":"2024-05-04T07:50:32.571866+0000","last_became_active":"2024-05-04T07:50:26.516874+0000","last_became_peered":"2024-05-04T07:50:26.516874+0000","last_unstale":"2024-05-04T07:50:32.571866+0000","last_undegraded":"2024-05-04T07:50:32.571866+0000","last_fullsized":"2024-05-04T07:50:32.571866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430645+0000","last_change":"2024-05-04T07:50:31.760635+0000","last_active":"2024-05-04T07:50:34.430645+0000","last_peered":"2024-05-04T07:50:34.430645+0000","last_clean":"2024-05-04T07:50:34.430645+0000","last_became_active":"2024-05-04T07:50:31.757079+0000","last_became_peered":"2024-05-04T07:50:31.757079+0000","last_unstale":"2024-05-04T07:50:34.430645+0000","last_undegraded":"2024-05-04T07:50:34.430645+0000","last_fullsized":"2024-05-04T07:50:34.430645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677343+0000","last_change":"2024-05-04T07:50:27.540454+0000","last_active":"2024-05-04T07:50:34.677343+0000","last_peered":"2024-05-04T07:50:34.677343+0000","last_clean":"2024-05-04T07:50:34.677343+0000","last_became_active":"2024-05-04T07:50:27.540144+0000","last_became_peered":"2024-05-04T07:50:27.540144+0000","last_unstale":"2024-05-04T07:50:34.677343+0000","last_undegraded":"2024-05-04T07:50:34.677343+0000","last_fullsized":"2024-05-04T07:50:34.677343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:22:48.132820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577699+0000","last_change":"2024-05-04T07:50:26.503229+0000","last_active":"2024-05-04T07:50:32.577699+0000","last_peered":"2024-05-04T07:50:32.577699+0000","last_clean":"2024-05-04T07:50:32.577699+0000","last_became_active":"2024-05-04T07:50:26.502831+0000","last_became_peered":"2024-05-04T07:50:26.502831+0000","last_unstale":"2024-05-04T07:50:32.577699+0000","last_undegraded":"2024-05-04T07:50:32.577699+0000","last_fullsized":"2024-05-04T07:50:32.577699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:08:59.681592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575067+0000","last_change":"2024-05-04T07:50:31.575538+0000","last_active":"2024-05-04T07:50:32.575067+0000","last_peered":"2024-05-04T07:50:32.575067+0000","last_clean":"2024-05-04T07:50:32.575067+0000","last_became_active":"2024-05-04T07:50:31.575246+0000","last_became_peered":"2024-05-04T07:50:31.575246+0000","last_unstale":"2024-05-04T07:50:32.575067+0000","last_undegraded":"2024-05-04T07:50:32.575067+0000","last_fullsized":"2024-05-04T07:50:32.575067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:59.402800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676420+0000","last_change":"2024-05-04T07:50:27.522684+0000","last_active":"2024-05-04T07:50:34.676420+0000","last_peered":"2024-05-04T07:50:34.676420+0000","last_clean":"2024-05-04T07:50:34.676420+0000","last_became_active":"2024-05-04T07:50:27.522411+0000","last_became_peered":"2024-05-04T07:50:27.522411+0000","last_unstale":"2024-05-04T07:50:34.676420+0000","last_undegraded":"2024-05-04T07:50:34.676420+0000","last_fullsized":"2024-05-04T07:50:34.676420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570481+0000","last_change":"2024-05-04T07:50:26.506955+0000","last_active":"2024-05-04T07:50:32.570481+0000","last_peered":"2024-05-04T07:50:32.570481+0000","last_clean":"2024-05-04T07:50:32.570481+0000","last_became_active":"2024-05-04T07:50:26.506608+0000","last_became_peered":"2024-05-04T07:50:26.506608+0000","last_unstale":"2024-05-04T07:50:32.570481+0000","last_undegraded":"2024-05-04T07:50:32.570481+0000","last_fullsized":"2024-05-04T07:50:32.570481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907170+0000","last_change":"2024-05-04T07:50:31.555725+0000","last_active":"2024-05-04T07:50:34.907170+0000","last_peered":"2024-05-04T07:50:34.907170+0000","last_clean":"2024-05-04T07:50:34.907170+0000","last_became_active":"2024-05-04T07:50:31.555270+0000","last_became_peered":"2024-05-04T07:50:31.555270+0000","last_unstale":"2024-05-04T07:50:34.907170+0000","last_undegraded":"2024-05-04T07:50:34.907170+0000","last_fullsized":"2024-05-04T07:50:34.907170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:44.773246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573323+0000","last_change":"2024-05-04T07:50:27.518477+0000","last_active":"2024-05-04T07:50:32.573323+0000","last_peered":"2024-05-04T07:50:32.573323+0000","last_clean":"2024-05-04T07:50:32.573323+0000","last_became_active":"2024-05-04T07:50:27.517791+0000","last_became_peered":"2024-05-04T07:50:27.517791+0000","last_unstale":"2024-05-04T07:50:32.573323+0000","last_undegraded":"2024-05-04T07:50:32.573323+0000","last_fullsized":"2024-05-04T07:50:32.573323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.573574+0000","last_change":"2024-05-04T07:50:26.510434+0000","last_active":"2024-05-04T07:50:32.573574+0000","last_peered":"2024-05-04T07:50:32.573574+0000","last_clean":"2024-05-04T07:50:32.573574+0000","last_became_active":"2024-05-04T07:50:26.510119+0000","last_became_peered":"2024-05-04T07:50:26.510119+0000","last_unstale":"2024-05-04T07:50:32.573574+0000","last_undegraded":"2024-05-04T07:50:32.573574+0000","last_fullsized":"2024-05-04T07:50:32.573574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:01:45.009304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885212+0000","last_change":"2024-05-04T07:50:31.756666+0000","last_active":"2024-05-04T07:50:34.885212+0000","last_peered":"2024-05-04T07:50:34.885212+0000","last_clean":"2024-05-04T07:50:34.885212+0000","last_became_active":"2024-05-04T07:50:31.756249+0000","last_became_peered":"2024-05-04T07:50:31.756249+0000","last_unstale":"2024-05-04T07:50:34.885212+0000","last_undegraded":"2024-05-04T07:50:34.885212+0000","last_fullsized":"2024-05-04T07:50:34.885212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:37:24.803569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676890+0000","last_change":"2024-05-04T07:50:27.540674+0000","last_active":"2024-05-04T07:50:34.676890+0000","last_peered":"2024-05-04T07:50:34.676890+0000","last_clean":"2024-05-04T07:50:34.676890+0000","last_became_active":"2024-05-04T07:50:27.540424+0000","last_became_peered":"2024-05-04T07:50:27.540424+0000","last_unstale":"2024-05-04T07:50:34.676890+0000","last_undegraded":"2024-05-04T07:50:34.676890+0000","last_fullsized":"2024-05-04T07:50:34.676890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:33.626601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431291+0000","last_change":"2024-05-04T07:50:26.523666+0000","last_active":"2024-05-04T07:50:34.431291+0000","last_peered":"2024-05-04T07:50:34.431291+0000","last_clean":"2024-05-04T07:50:34.431291+0000","last_became_active":"2024-05-04T07:50:26.522969+0000","last_became_peered":"2024-05-04T07:50:26.522969+0000","last_unstale":"2024-05-04T07:50:34.431291+0000","last_undegraded":"2024-05-04T07:50:34.431291+0000","last_fullsized":"2024-05-04T07:50:34.431291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:51.372178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884708+0000","last_change":"2024-05-04T07:50:31.748030+0000","last_active":"2024-05-04T07:50:34.884708+0000","last_peered":"2024-05-04T07:50:34.884708+0000","last_clean":"2024-05-04T07:50:34.884708+0000","last_became_active":"2024-05-04T07:50:31.746933+0000","last_became_peered":"2024-05-04T07:50:31.746933+0000","last_unstale":"2024-05-04T07:50:34.884708+0000","last_undegraded":"2024-05-04T07:50:34.884708+0000","last_fullsized":"2024-05-04T07:50:34.884708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:09:59.415101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906640+0000","last_change":"2024-05-04T07:50:27.527928+0000","last_active":"2024-05-04T07:50:34.906640+0000","last_peered":"2024-05-04T07:50:34.906640+0000","last_clean":"2024-05-04T07:50:34.906640+0000","last_became_active":"2024-05-04T07:50:27.527533+0000","last_became_peered":"2024-05-04T07:50:27.527533+0000","last_unstale":"2024-05-04T07:50:34.906640+0000","last_undegraded":"2024-05-04T07:50:34.906640+0000","last_fullsized":"2024-05-04T07:50:34.906640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:40:38.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.905602+0000","last_change":"2024-05-04T07:50:26.513336+0000","last_active":"2024-05-04T07:50:34.905602+0000","last_peered":"2024-05-04T07:50:34.905602+0000","last_clean":"2024-05-04T07:50:34.905602+0000","last_became_active":"2024-05-04T07:50:26.512985+0000","last_became_peered":"2024-05-04T07:50:26.512985+0000","last_unstale":"2024-05-04T07:50:34.905602+0000","last_undegraded":"2024-05-04T07:50:34.905602+0000","last_fullsized":"2024-05-04T07:50:34.905602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:06.202371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432021+0000","last_change":"2024-05-04T07:50:31.749461+0000","last_active":"2024-05-04T07:50:34.432021+0000","last_peered":"2024-05-04T07:50:34.432021+0000","last_clean":"2024-05-04T07:50:34.432021+0000","last_became_active":"2024-05-04T07:50:31.748351+0000","last_became_peered":"2024-05-04T07:50:31.748351+0000","last_unstale":"2024-05-04T07:50:34.432021+0000","last_undegraded":"2024-05-04T07:50:34.432021+0000","last_fullsized":"2024-05-04T07:50:34.432021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676838+0000","last_change":"2024-05-04T07:50:27.521782+0000","last_active":"2024-05-04T07:50:34.676838+0000","last_peered":"2024-05-04T07:50:34.676838+0000","last_clean":"2024-05-04T07:50:34.676838+0000","last_became_active":"2024-05-04T07:50:27.521501+0000","last_became_peered":"2024-05-04T07:50:27.521501+0000","last_unstale":"2024-05-04T07:50:34.676838+0000","last_undegraded":"2024-05-04T07:50:34.676838+0000","last_fullsized":"2024-05-04T07:50:34.676838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:39.662272+0000","last_change":"2024-05-04T07:50:26.523082+0000","last_active":"2024-05-04T07:50:39.662272+0000","last_peered":"2024-05-04T07:50:39.662272+0000","last_clean":"2024-05-04T07:50:39.662272+0000","last_became_active":"2024-05-04T07:50:26.522745+0000","last_became_peered":"2024-05-04T07:50:26.522745+0000","last_unstale":"2024-05-04T07:50:39.662272+0000","last_undegraded":"2024-05-04T07:50:39.662272+0000","last_fullsized":"2024-05-04T07:50:39.662272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706176+0000","last_change":"2024-05-04T07:50:31.564157+0000","last_active":"2024-05-04T07:50:34.706176+0000","last_peered":"2024-05-04T07:50:34.706176+0000","last_clean":"2024-05-04T07:50:34.706176+0000","last_became_active":"2024-05-04T07:50:31.563164+0000","last_became_peered":"2024-05-04T07:50:31.563164+0000","last_unstale":"2024-05-04T07:50:34.706176+0000","last_undegraded":"2024-05-04T07:50:34.706176+0000","last_fullsized":"2024-05-04T07:50:34.706176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:42.039524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575072+0000","last_change":"2024-05-04T07:50:27.525542+0000","last_active":"2024-05-04T07:50:32.575072+0000","last_peered":"2024-05-04T07:50:32.575072+0000","last_clean":"2024-05-04T07:50:32.575072+0000","last_became_active":"2024-05-04T07:50:27.525248+0000","last_became_peered":"2024-05-04T07:50:27.525248+0000","last_unstale":"2024-05-04T07:50:32.575072+0000","last_undegraded":"2024-05-04T07:50:32.575072+0000","last_fullsized":"2024-05-04T07:50:32.575072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:52:28.619214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705230+0000","last_change":"2024-05-04T07:50:26.518937+0000","last_active":"2024-05-04T07:50:34.705230+0000","last_peered":"2024-05-04T07:50:34.705230+0000","last_clean":"2024-05-04T07:50:34.705230+0000","last_became_active":"2024-05-04T07:50:26.518493+0000","last_became_peered":"2024-05-04T07:50:26.518493+0000","last_unstale":"2024-05-04T07:50:34.705230+0000","last_undegraded":"2024-05-04T07:50:34.705230+0000","last_fullsized":"2024-05-04T07:50:34.705230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:12.314804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575567+0000","last_change":"2024-05-04T07:50:31.568993+0000","last_active":"2024-05-04T07:50:32.575567+0000","last_peered":"2024-05-04T07:50:32.575567+0000","last_clean":"2024-05-04T07:50:32.575567+0000","last_became_active":"2024-05-04T07:50:31.568477+0000","last_became_peered":"2024-05-04T07:50:31.568477+0000","last_unstale":"2024-05-04T07:50:32.575567+0000","last_undegraded":"2024-05-04T07:50:32.575567+0000","last_fullsized":"2024-05-04T07:50:32.575567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:23.224976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.908175+0000","last_change":"2024-05-04T07:50:27.532480+0000","last_active":"2024-05-04T07:50:34.908175+0000","last_peered":"2024-05-04T07:50:34.908175+0000","last_clean":"2024-05-04T07:50:34.908175+0000","last_became_active":"2024-05-04T07:50:27.532194+0000","last_became_peered":"2024-05-04T07:50:27.532194+0000","last_unstale":"2024-05-04T07:50:34.908175+0000","last_undegraded":"2024-05-04T07:50:34.908175+0000","last_fullsized":"2024-05-04T07:50:34.908175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432284+0000","last_change":"2024-05-04T07:50:26.517065+0000","last_active":"2024-05-04T07:50:34.432284+0000","last_peered":"2024-05-04T07:50:34.432284+0000","last_clean":"2024-05-04T07:50:34.432284+0000","last_became_active":"2024-05-04T07:50:26.516714+0000","last_became_peered":"2024-05-04T07:50:26.516714+0000","last_unstale":"2024-05-04T07:50:34.432284+0000","last_undegraded":"2024-05-04T07:50:34.432284+0000","last_fullsized":"2024-05-04T07:50:34.432284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883217+0000","last_change":"2024-05-04T07:50:31.561005+0000","last_active":"2024-05-04T07:50:34.883217+0000","last_peered":"2024-05-04T07:50:34.883217+0000","last_clean":"2024-05-04T07:50:34.883217+0000","last_became_active":"2024-05-04T07:50:31.560530+0000","last_became_peered":"2024-05-04T07:50:31.560530+0000","last_unstale":"2024-05-04T07:50:34.883217+0000","last_undegraded":"2024-05-04T07:50:34.883217+0000","last_fullsized":"2024-05-04T07:50:34.883217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:45:48.638279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431967+0000","last_change":"2024-05-04T07:50:27.527644+0000","last_active":"2024-05-04T07:50:34.431967+0000","last_peered":"2024-05-04T07:50:34.431967+0000","last_clean":"2024-05-04T07:50:34.431967+0000","last_became_active":"2024-05-04T07:50:27.527144+0000","last_became_peered":"2024-05-04T07:50:27.527144+0000","last_unstale":"2024-05-04T07:50:34.431967+0000","last_undegraded":"2024-05-04T07:50:34.431967+0000","last_fullsized":"2024-05-04T07:50:34.431967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:59:59.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577526+0000","last_change":"2024-05-04T07:50:26.513482+0000","last_active":"2024-05-04T07:50:32.577526+0000","last_peered":"2024-05-04T07:50:32.577526+0000","last_clean":"2024-05-04T07:50:32.577526+0000","last_became_active":"2024-05-04T07:50:26.513184+0000","last_became_peered":"2024-05-04T07:50:26.513184+0000","last_unstale":"2024-05-04T07:50:32.577526+0000","last_undegraded":"2024-05-04T07:50:32.577526+0000","last_fullsized":"2024-05-04T07:50:32.577526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:18:59.055882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883725+0000","last_change":"2024-05-04T07:50:31.758024+0000","last_active":"2024-05-04T07:50:34.883725+0000","last_peered":"2024-05-04T07:50:34.883725+0000","last_clean":"2024-05-04T07:50:34.883725+0000","last_became_active":"2024-05-04T07:50:31.756399+0000","last_became_peered":"2024-05-04T07:50:31.756399+0000","last_unstale":"2024-05-04T07:50:34.883725+0000","last_undegraded":"2024-05-04T07:50:34.883725+0000","last_fullsized":"2024-05-04T07:50:34.883725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:23:37.938641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907003+0000","last_change":"2024-05-04T07:50:31.757980+0000","last_active":"2024-05-04T07:50:34.907003+0000","last_peered":"2024-05-04T07:50:34.907003+0000","last_clean":"2024-05-04T07:50:34.907003+0000","last_became_active":"2024-05-04T07:50:31.756577+0000","last_became_peered":"2024-05-04T07:50:31.756577+0000","last_unstale":"2024-05-04T07:50:34.907003+0000","last_undegraded":"2024-05-04T07:50:34.907003+0000","last_fullsized":"2024-05-04T07:50:34.907003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:18:37.678478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705484+0000","last_change":"2024-05-04T07:50:27.513707+0000","last_active":"2024-05-04T07:50:34.705484+0000","last_peered":"2024-05-04T07:50:34.705484+0000","last_clean":"2024-05-04T07:50:34.705484+0000","last_became_active":"2024-05-04T07:50:27.513407+0000","last_became_peered":"2024-05-04T07:50:27.513407+0000","last_unstale":"2024-05-04T07:50:34.705484+0000","last_undegraded":"2024-05-04T07:50:34.705484+0000","last_fullsized":"2024-05-04T07:50:34.705484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431437+0000","last_change":"2024-05-04T07:50:26.521863+0000","last_active":"2024-05-04T07:50:34.431437+0000","last_peered":"2024-05-04T07:50:34.431437+0000","last_clean":"2024-05-04T07:50:34.431437+0000","last_became_active":"2024-05-04T07:50:26.521362+0000","last_became_peered":"2024-05-04T07:50:26.521362+0000","last_unstale":"2024-05-04T07:50:34.431437+0000","last_undegraded":"2024-05-04T07:50:34.431437+0000","last_fullsized":"2024-05-04T07:50:34.431437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:32.048650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577533+0000","last_change":"2024-05-04T07:50:31.567080+0000","last_active":"2024-05-04T07:50:32.577533+0000","last_peered":"2024-05-04T07:50:32.577533+0000","last_clean":"2024-05-04T07:50:32.577533+0000","last_became_active":"2024-05-04T07:50:31.566643+0000","last_became_peered":"2024-05-04T07:50:31.566643+0000","last_unstale":"2024-05-04T07:50:32.577533+0000","last_undegraded":"2024-05-04T07:50:32.577533+0000","last_fullsized":"2024-05-04T07:50:32.577533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:44.815531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883291+0000","last_change":"2024-05-04T07:50:27.517785+0000","last_active":"2024-05-04T07:50:34.883291+0000","last_peered":"2024-05-04T07:50:34.883291+0000","last_clean":"2024-05-04T07:50:34.883291+0000","last_became_active":"2024-05-04T07:50:27.517532+0000","last_became_peered":"2024-05-04T07:50:27.517532+0000","last_unstale":"2024-05-04T07:50:34.883291+0000","last_undegraded":"2024-05-04T07:50:34.883291+0000","last_fullsized":"2024-05-04T07:50:34.883291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882248+0000","last_change":"2024-05-04T07:50:26.516109+0000","last_active":"2024-05-04T07:50:34.882248+0000","last_peered":"2024-05-04T07:50:34.882248+0000","last_clean":"2024-05-04T07:50:34.882248+0000","last_became_active":"2024-05-04T07:50:26.515518+0000","last_became_peered":"2024-05-04T07:50:26.515518+0000","last_unstale":"2024-05-04T07:50:34.882248+0000","last_undegraded":"2024-05-04T07:50:34.882248+0000","last_fullsized":"2024-05-04T07:50:34.882248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:32.819062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.575304+0000","last_change":"2024-05-04T07:50:26.509275+0000","last_active":"2024-05-04T07:50:32.575304+0000","last_peered":"2024-05-04T07:50:32.575304+0000","last_clean":"2024-05-04T07:50:32.575304+0000","last_became_active":"2024-05-04T07:50:26.505492+0000","last_became_peered":"2024-05-04T07:50:26.505492+0000","last_unstale":"2024-05-04T07:50:32.575304+0000","last_undegraded":"2024-05-04T07:50:32.575304+0000","last_fullsized":"2024-05-04T07:50:32.575304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:26.541029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907512+0000","last_change":"2024-05-04T07:50:27.514230+0000","last_active":"2024-05-04T07:50:34.907512+0000","last_peered":"2024-05-04T07:50:34.907512+0000","last_clean":"2024-05-04T07:50:34.907512+0000","last_became_active":"2024-05-04T07:50:27.512993+0000","last_became_peered":"2024-05-04T07:50:27.512993+0000","last_unstale":"2024-05-04T07:50:34.907512+0000","last_undegraded":"2024-05-04T07:50:34.907512+0000","last_fullsized":"2024-05-04T07:50:34.907512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571374+0000","last_change":"2024-05-04T07:50:31.565560+0000","last_active":"2024-05-04T07:50:32.571374+0000","last_peered":"2024-05-04T07:50:32.571374+0000","last_clean":"2024-05-04T07:50:32.571374+0000","last_became_active":"2024-05-04T07:50:31.564371+0000","last_became_peered":"2024-05-04T07:50:31.564371+0000","last_unstale":"2024-05-04T07:50:32.571374+0000","last_undegraded":"2024-05-04T07:50:32.571374+0000","last_fullsized":"2024-05-04T07:50:32.571374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:16.936001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884400+0000","last_change":"2024-05-04T07:50:26.516509+0000","last_active":"2024-05-04T07:50:34.884400+0000","last_peered":"2024-05-04T07:50:34.884400+0000","last_clean":"2024-05-04T07:50:34.884400+0000","last_became_active":"2024-05-04T07:50:26.516120+0000","last_became_peered":"2024-05-04T07:50:26.516120+0000","last_unstale":"2024-05-04T07:50:34.884400+0000","last_undegraded":"2024-05-04T07:50:34.884400+0000","last_fullsized":"2024-05-04T07:50:34.884400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:25.449896+0000","last_clean_scrub_stamp":"2024-05-04T07:50:25.449896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:29.810962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574616+0000","last_change":"2024-05-04T07:50:27.515095+0000","last_active":"2024-05-04T07:50:32.574616+0000","last_peered":"2024-05-04T07:50:32.574616+0000","last_clean":"2024-05-04T07:50:32.574616+0000","last_became_active":"2024-05-04T07:50:27.514715+0000","last_became_peered":"2024-05-04T07:50:27.514715+0000","last_unstale":"2024-05-04T07:50:32.574616+0000","last_undegraded":"2024-05-04T07:50:32.574616+0000","last_fullsized":"2024-05-04T07:50:32.574616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:19:00.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884950+0000","last_change":"2024-05-04T07:50:31.561861+0000","last_active":"2024-05-04T07:50:34.884950+0000","last_peered":"2024-05-04T07:50:34.884950+0000","last_clean":"2024-05-04T07:50:34.884950+0000","last_became_active":"2024-05-04T07:50:31.561513+0000","last_became_peered":"2024-05-04T07:50:31.561513+0000","last_unstale":"2024-05-04T07:50:34.884950+0000","last_undegraded":"2024-05-04T07:50:34.884950+0000","last_fullsized":"2024-05-04T07:50:34.884950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:30.514831+0000","last_clean_scrub_stamp":"2024-05-04T07:50:30.514831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:47:50.794538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.572760+0000","last_change":"2024-05-04T07:50:27.518744+0000","last_active":"2024-05-04T07:50:32.572760+0000","last_peered":"2024-05-04T07:50:32.572760+0000","last_clean":"2024-05-04T07:50:32.572760+0000","last_became_active":"2024-05-04T07:50:27.518199+0000","last_became_peered":"2024-05-04T07:50:27.518199+0000","last_unstale":"2024-05-04T07:50:32.572760+0000","last_undegraded":"2024-05-04T07:50:32.572760+0000","last_fullsized":"2024-05-04T07:50:32.572760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.570708+0000","last_change":"2024-05-04T07:50:27.523376+0000","last_active":"2024-05-04T07:50:32.570708+0000","last_peered":"2024-05-04T07:50:32.570708+0000","last_clean":"2024-05-04T07:50:32.570708+0000","last_became_active":"2024-05-04T07:50:27.523130+0000","last_became_peered":"2024-05-04T07:50:27.523130+0000","last_unstale":"2024-05-04T07:50:32.570708+0000","last_undegraded":"2024-05-04T07:50:32.570708+0000","last_fullsized":"2024-05-04T07:50:32.570708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431205+0000","last_change":"2024-05-04T07:50:27.530509+0000","last_active":"2024-05-04T07:50:34.431205+0000","last_peered":"2024-05-04T07:50:34.431205+0000","last_clean":"2024-05-04T07:50:34.431205+0000","last_became_active":"2024-05-04T07:50:27.515836+0000","last_became_peered":"2024-05-04T07:50:27.515836+0000","last_unstale":"2024-05-04T07:50:34.431205+0000","last_undegraded":"2024-05-04T07:50:34.431205+0000","last_fullsized":"2024-05-04T07:50:34.431205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:52:07.102890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907284+0000","last_change":"2024-05-04T07:50:27.514059+0000","last_active":"2024-05-04T07:50:34.907284+0000","last_peered":"2024-05-04T07:50:34.907284+0000","last_clean":"2024-05-04T07:50:34.907284+0000","last_became_active":"2024-05-04T07:50:27.513683+0000","last_became_peered":"2024-05-04T07:50:27.513683+0000","last_unstale":"2024-05-04T07:50:34.907284+0000","last_undegraded":"2024-05-04T07:50:34.907284+0000","last_fullsized":"2024-05-04T07:50:34.907284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:52.385237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884958+0000","last_change":"2024-05-04T07:50:27.512681+0000","last_active":"2024-05-04T07:50:34.884958+0000","last_peered":"2024-05-04T07:50:34.884958+0000","last_clean":"2024-05-04T07:50:34.884958+0000","last_became_active":"2024-05-04T07:50:27.512396+0000","last_became_peered":"2024-05-04T07:50:27.512396+0000","last_unstale":"2024-05-04T07:50:34.884958+0000","last_undegraded":"2024-05-04T07:50:34.884958+0000","last_fullsized":"2024-05-04T07:50:34.884958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.706559+0000","last_change":"2024-05-04T07:50:27.513740+0000","last_active":"2024-05-04T07:50:34.706559+0000","last_peered":"2024-05-04T07:50:34.706559+0000","last_clean":"2024-05-04T07:50:34.706559+0000","last_became_active":"2024-05-04T07:50:27.513429+0000","last_became_peered":"2024-05-04T07:50:27.513429+0000","last_unstale":"2024-05-04T07:50:34.706559+0000","last_undegraded":"2024-05-04T07:50:34.706559+0000","last_fullsized":"2024-05-04T07:50:34.706559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578213+0000","last_change":"2024-05-04T07:50:27.523815+0000","last_active":"2024-05-04T07:50:32.578213+0000","last_peered":"2024-05-04T07:50:32.578213+0000","last_clean":"2024-05-04T07:50:32.578213+0000","last_became_active":"2024-05-04T07:50:27.520965+0000","last_became_peered":"2024-05-04T07:50:27.520965+0000","last_unstale":"2024-05-04T07:50:32.578213+0000","last_undegraded":"2024-05-04T07:50:32.578213+0000","last_fullsized":"2024-05-04T07:50:32.578213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.885181+0000","last_change":"2024-05-04T07:50:27.512542+0000","last_active":"2024-05-04T07:50:34.885181+0000","last_peered":"2024-05-04T07:50:34.885181+0000","last_clean":"2024-05-04T07:50:34.885181+0000","last_became_active":"2024-05-04T07:50:27.511791+0000","last_became_peered":"2024-05-04T07:50:27.511791+0000","last_unstale":"2024-05-04T07:50:34.885181+0000","last_undegraded":"2024-05-04T07:50:34.885181+0000","last_fullsized":"2024-05-04T07:50:34.885181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431166+0000","last_change":"2024-05-04T07:50:27.525062+0000","last_active":"2024-05-04T07:50:34.431166+0000","last_peered":"2024-05-04T07:50:34.431166+0000","last_clean":"2024-05-04T07:50:34.431166+0000","last_became_active":"2024-05-04T07:50:27.523669+0000","last_became_peered":"2024-05-04T07:50:27.523669+0000","last_unstale":"2024-05-04T07:50:34.431166+0000","last_undegraded":"2024-05-04T07:50:34.431166+0000","last_fullsized":"2024-05-04T07:50:34.431166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:09:55.350924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.883783+0000","last_change":"2024-05-04T07:50:27.529011+0000","last_active":"2024-05-04T07:50:34.883783+0000","last_peered":"2024-05-04T07:50:34.883783+0000","last_clean":"2024-05-04T07:50:34.883783+0000","last_became_active":"2024-05-04T07:50:27.518430+0000","last_became_peered":"2024-05-04T07:50:27.518430+0000","last_unstale":"2024-05-04T07:50:34.883783+0000","last_undegraded":"2024-05-04T07:50:34.883783+0000","last_fullsized":"2024-05-04T07:50:34.883783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431100+0000","last_change":"2024-05-04T07:50:27.535855+0000","last_active":"2024-05-04T07:50:34.431100+0000","last_peered":"2024-05-04T07:50:34.431100+0000","last_clean":"2024-05-04T07:50:34.431100+0000","last_became_active":"2024-05-04T07:50:27.535085+0000","last_became_peered":"2024-05-04T07:50:27.535085+0000","last_unstale":"2024-05-04T07:50:34.431100+0000","last_undegraded":"2024-05-04T07:50:34.431100+0000","last_fullsized":"2024-05-04T07:50:34.431100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906800+0000","last_change":"2024-05-04T07:50:27.517267+0000","last_active":"2024-05-04T07:50:34.906800+0000","last_peered":"2024-05-04T07:50:34.906800+0000","last_clean":"2024-05-04T07:50:34.906800+0000","last_became_active":"2024-05-04T07:50:27.516417+0000","last_became_peered":"2024-05-04T07:50:27.516417+0000","last_unstale":"2024-05-04T07:50:34.906800+0000","last_undegraded":"2024-05-04T07:50:34.906800+0000","last_fullsized":"2024-05-04T07:50:34.906800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.576402+0000","last_change":"2024-05-04T07:50:27.532237+0000","last_active":"2024-05-04T07:50:32.576402+0000","last_peered":"2024-05-04T07:50:32.576402+0000","last_clean":"2024-05-04T07:50:32.576402+0000","last_became_active":"2024-05-04T07:50:27.530803+0000","last_became_peered":"2024-05-04T07:50:27.530803+0000","last_unstale":"2024-05-04T07:50:32.576402+0000","last_undegraded":"2024-05-04T07:50:32.576402+0000","last_fullsized":"2024-05-04T07:50:32.576402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:27:48.608904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677498+0000","last_change":"2024-05-04T07:50:27.521954+0000","last_active":"2024-05-04T07:50:34.677498+0000","last_peered":"2024-05-04T07:50:34.677498+0000","last_clean":"2024-05-04T07:50:34.677498+0000","last_became_active":"2024-05-04T07:50:27.521647+0000","last_became_peered":"2024-05-04T07:50:27.521647+0000","last_unstale":"2024-05-04T07:50:34.677498+0000","last_undegraded":"2024-05-04T07:50:34.677498+0000","last_fullsized":"2024-05-04T07:50:34.677498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:28:40.763654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.571683+0000","last_change":"2024-05-04T07:50:27.514465+0000","last_active":"2024-05-04T07:50:32.571683+0000","last_peered":"2024-05-04T07:50:32.571683+0000","last_clean":"2024-05-04T07:50:32.571683+0000","last_became_active":"2024-05-04T07:50:27.514167+0000","last_became_peered":"2024-05-04T07:50:27.514167+0000","last_unstale":"2024-05-04T07:50:32.571683+0000","last_undegraded":"2024-05-04T07:50:32.571683+0000","last_fullsized":"2024-05-04T07:50:32.571683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:20:17.663860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.432381+0000","last_change":"2024-05-04T07:50:27.532760+0000","last_active":"2024-05-04T07:50:34.432381+0000","last_peered":"2024-05-04T07:50:34.432381+0000","last_clean":"2024-05-04T07:50:34.432381+0000","last_became_active":"2024-05-04T07:50:27.532227+0000","last_became_peered":"2024-05-04T07:50:27.532227+0000","last_unstale":"2024-05-04T07:50:34.432381+0000","last_undegraded":"2024-05-04T07:50:34.432381+0000","last_fullsized":"2024-05-04T07:50:34.432381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:12:59.968914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430627+0000","last_change":"2024-05-04T07:50:27.526544+0000","last_active":"2024-05-04T07:50:34.430627+0000","last_peered":"2024-05-04T07:50:34.430627+0000","last_clean":"2024-05-04T07:50:34.430627+0000","last_became_active":"2024-05-04T07:50:27.523814+0000","last_became_peered":"2024-05-04T07:50:27.523814+0000","last_unstale":"2024-05-04T07:50:34.430627+0000","last_undegraded":"2024-05-04T07:50:34.430627+0000","last_fullsized":"2024-05-04T07:50:34.430627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.705529+0000","last_change":"2024-05-04T07:50:27.520067+0000","last_active":"2024-05-04T07:50:34.705529+0000","last_peered":"2024-05-04T07:50:34.705529+0000","last_clean":"2024-05-04T07:50:34.705529+0000","last_became_active":"2024-05-04T07:50:27.519793+0000","last_became_peered":"2024-05-04T07:50:27.519793+0000","last_unstale":"2024-05-04T07:50:34.705529+0000","last_undegraded":"2024-05-04T07:50:34.705529+0000","last_fullsized":"2024-05-04T07:50:34.705529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:42:16.053263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.906569+0000","last_change":"2024-05-04T07:50:27.519351+0000","last_active":"2024-05-04T07:50:34.906569+0000","last_peered":"2024-05-04T07:50:34.906569+0000","last_clean":"2024-05-04T07:50:34.906569+0000","last_became_active":"2024-05-04T07:50:27.519113+0000","last_became_peered":"2024-05-04T07:50:27.519113+0000","last_unstale":"2024-05-04T07:50:34.906569+0000","last_undegraded":"2024-05-04T07:50:34.906569+0000","last_fullsized":"2024-05-04T07:50:34.906569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:09:08.397148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.884191+0000","last_change":"2024-05-04T07:50:27.512150+0000","last_active":"2024-05-04T07:50:34.884191+0000","last_peered":"2024-05-04T07:50:34.884191+0000","last_clean":"2024-05-04T07:50:34.884191+0000","last_became_active":"2024-05-04T07:50:27.511803+0000","last_became_peered":"2024-05-04T07:50:27.511803+0000","last_unstale":"2024-05-04T07:50:34.884191+0000","last_undegraded":"2024-05-04T07:50:34.884191+0000","last_fullsized":"2024-05-04T07:50:34.884191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.574754+0000","last_change":"2024-05-04T07:50:27.515638+0000","last_active":"2024-05-04T07:50:32.574754+0000","last_peered":"2024-05-04T07:50:32.574754+0000","last_clean":"2024-05-04T07:50:32.574754+0000","last_became_active":"2024-05-04T07:50:27.515369+0000","last_became_peered":"2024-05-04T07:50:27.515369+0000","last_unstale":"2024-05-04T07:50:32.574754+0000","last_undegraded":"2024-05-04T07:50:32.574754+0000","last_fullsized":"2024-05-04T07:50:32.574754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:04:13.327862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.577020+0000","last_change":"2024-05-04T07:50:27.526027+0000","last_active":"2024-05-04T07:50:32.577020+0000","last_peered":"2024-05-04T07:50:32.577020+0000","last_clean":"2024-05-04T07:50:32.577020+0000","last_became_active":"2024-05-04T07:50:27.525765+0000","last_became_peered":"2024-05-04T07:50:27.525765+0000","last_unstale":"2024-05-04T07:50:32.577020+0000","last_undegraded":"2024-05-04T07:50:32.577020+0000","last_fullsized":"2024-05-04T07:50:32.577020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:32.578172+0000","last_change":"2024-05-04T07:50:27.528920+0000","last_active":"2024-05-04T07:50:32.578172+0000","last_peered":"2024-05-04T07:50:32.578172+0000","last_clean":"2024-05-04T07:50:32.578172+0000","last_became_active":"2024-05-04T07:50:27.528633+0000","last_became_peered":"2024-05-04T07:50:27.528633+0000","last_unstale":"2024-05-04T07:50:32.578172+0000","last_undegraded":"2024-05-04T07:50:32.578172+0000","last_fullsized":"2024-05-04T07:50:32.578172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:41:46.003811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677737+0000","last_change":"2024-05-04T07:50:27.539050+0000","last_active":"2024-05-04T07:50:34.677737+0000","last_peered":"2024-05-04T07:50:34.677737+0000","last_clean":"2024-05-04T07:50:34.677737+0000","last_became_active":"2024-05-04T07:50:27.538566+0000","last_became_peered":"2024-05-04T07:50:27.538566+0000","last_unstale":"2024-05-04T07:50:34.677737+0000","last_undegraded":"2024-05-04T07:50:34.677737+0000","last_fullsized":"2024-05-04T07:50:34.677737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:55:00.280798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.882986+0000","last_change":"2024-05-04T07:50:27.530248+0000","last_active":"2024-05-04T07:50:34.882986+0000","last_peered":"2024-05-04T07:50:34.882986+0000","last_clean":"2024-05-04T07:50:34.882986+0000","last_became_active":"2024-05-04T07:50:27.529931+0000","last_became_peered":"2024-05-04T07:50:27.529931+0000","last_unstale":"2024-05-04T07:50:34.882986+0000","last_undegraded":"2024-05-04T07:50:34.882986+0000","last_fullsized":"2024-05-04T07:50:34.882986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:35:19.757841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676252+0000","last_change":"2024-05-04T07:50:27.529562+0000","last_active":"2024-05-04T07:50:34.676252+0000","last_peered":"2024-05-04T07:50:34.676252+0000","last_clean":"2024-05-04T07:50:34.676252+0000","last_became_active":"2024-05-04T07:50:27.526146+0000","last_became_peered":"2024-05-04T07:50:27.526146+0000","last_unstale":"2024-05-04T07:50:34.676252+0000","last_undegraded":"2024-05-04T07:50:34.676252+0000","last_fullsized":"2024-05-04T07:50:34.676252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:43:40.721369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.430913+0000","last_change":"2024-05-04T07:50:27.535474+0000","last_active":"2024-05-04T07:50:34.430913+0000","last_peered":"2024-05-04T07:50:34.430913+0000","last_clean":"2024-05-04T07:50:34.430913+0000","last_became_active":"2024-05-04T07:50:27.534280+0000","last_became_peered":"2024-05-04T07:50:27.534280+0000","last_unstale":"2024-05-04T07:50:34.430913+0000","last_undegraded":"2024-05-04T07:50:34.430913+0000","last_fullsized":"2024-05-04T07:50:34.430913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:01:11.640697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.676579+0000","last_change":"2024-05-04T07:50:27.535375+0000","last_active":"2024-05-04T07:50:34.676579+0000","last_peered":"2024-05-04T07:50:34.676579+0000","last_clean":"2024-05-04T07:50:34.676579+0000","last_became_active":"2024-05-04T07:50:27.535098+0000","last_became_peered":"2024-05-04T07:50:27.535098+0000","last_unstale":"2024-05-04T07:50:34.676579+0000","last_undegraded":"2024-05-04T07:50:34.676579+0000","last_fullsized":"2024-05-04T07:50:34.676579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.431426+0000","last_change":"2024-05-04T07:50:27.524844+0000","last_active":"2024-05-04T07:50:34.431426+0000","last_peered":"2024-05-04T07:50:34.431426+0000","last_clean":"2024-05-04T07:50:34.431426+0000","last_became_active":"2024-05-04T07:50:27.516441+0000","last_became_peered":"2024-05-04T07:50:27.516441+0000","last_unstale":"2024-05-04T07:50:34.431426+0000","last_undegraded":"2024-05-04T07:50:34.431426+0000","last_fullsized":"2024-05-04T07:50:34.431426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:19.173100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.907140+0000","last_change":"2024-05-04T07:50:27.510561+0000","last_active":"2024-05-04T07:50:34.907140+0000","last_peered":"2024-05-04T07:50:34.907140+0000","last_clean":"2024-05-04T07:50:34.907140+0000","last_became_active":"2024-05-04T07:50:27.510197+0000","last_became_peered":"2024-05-04T07:50:27.510197+0000","last_unstale":"2024-05-04T07:50:34.907140+0000","last_undegraded":"2024-05-04T07:50:34.907140+0000","last_fullsized":"2024-05-04T07:50:34.907140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:09.109401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.707313+0000","last_change":"2024-05-04T07:50:27.520114+0000","last_active":"2024-05-04T07:50:34.707313+0000","last_peered":"2024-05-04T07:50:34.707313+0000","last_clean":"2024-05-04T07:50:34.707313+0000","last_became_active":"2024-05-04T07:50:27.518799+0000","last_became_peered":"2024-05-04T07:50:27.518799+0000","last_unstale":"2024-05-04T07:50:34.707313+0000","last_undegraded":"2024-05-04T07:50:34.707313+0000","last_fullsized":"2024-05-04T07:50:34.707313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:39:57.779036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-04T07:50:34.677494+0000","last_change":"2024-05-04T07:50:27.521160+0000","last_active":"2024-05-04T07:50:34.677494+0000","last_peered":"2024-05-04T07:50:34.677494+0000","last_clean":"2024-05-04T07:50:34.677494+0000","last_became_active":"2024-05-04T07:50:27.520786+0000","last_became_peered":"2024-05-04T07:50:27.520786+0000","last_unstale":"2024-05-04T07:50:34.677494+0000","last_undegraded":"2024-05-04T07:50:34.677494+0000","last_fullsized":"2024-05-04T07:50:34.677494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:26.462955+0000","last_clean_scrub_stamp":"2024-05-04T07:50:26.462955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:48:37.987648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:50:57.109 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T07:50:57.109 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-04T07:50:57.109 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-04T07:50:57.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-04T07:50:57.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.356+0000 7f4cd5e00640 1 Processor -- start 2024-05-04T07:50:57.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.356+0000 7f4cd5e00640 1 -- start start 2024-05-04T07:50:57.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cd5e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 0x7f4cd006d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cd5e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd006c440 con 0x7f4cd00b4610 2024-05-04T07:50:57.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cd5e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd01608a0 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cd5e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd006d050 con 0x7f4cd006d4e0 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cce000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4ccf400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 0x7f4cd006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cce000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:59044/0 (socket says 172.21.15.136:59044) 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4cce000640 1 -- 172.21.15.136:0/1760927044 learned_addr learned my addr 172.21.15.136:0/1760927044 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.358+0000 7f4ccea00640 1 --1- 172.21.15.136:0/1760927044 >> v1:172.21.15.142:6789/0 conn(0x7f4cd00b4610 0x7f4cd00b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:44034/0 (socket says 172.21.15.136:44034) 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccd600640 1 -- 172.21.15.136:0/1760927044 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771151076 0 0) 0x7f4cd006c440 con 0x7f4cd00b4610 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccd600640 1 -- 172.21.15.136:0/1760927044 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb4003520 con 0x7f4cd00b4610 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccf400640 1 -- 172.21.15.136:0/1760927044 >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 msgr2=0x7f4cd015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccf400640 1 --2- 172.21.15.136:0/1760927044 >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccf400640 1 -- 172.21.15.136:0/1760927044 >> v1:172.21.15.142:6789/0 conn(0x7f4cd00b4610 legacy=0x7f4cd00b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4ccf400640 1 -- 172.21.15.136:0/1760927044 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd006c720 con 0x7f4cd006d4e0 2024-05-04T07:50:57.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.359+0000 7f4cce000640 1 --2- 172.21.15.136:0/1760927044 >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.361+0000 7f4ccf400640 1 --2- 172.21.15.136:0/1760927044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 0x7f4cd006d970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80097a0 tx=0x7f4cc802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5625c7d4bc2f2189 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.361+0000 7f4ccd600640 1 -- 172.21.15.136:0/1760927044 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8037070 con 0x7f4cd006d4e0 2024-05-04T07:50:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.361+0000 7f4ccd600640 1 -- 172.21.15.136:0/1760927044 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8032440 con 0x7f4cd006d4e0 2024-05-04T07:50:57.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.361+0000 7f4ccd600640 1 -- 172.21.15.136:0/1760927044 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8032810 con 0x7f4cd006d4e0 2024-05-04T07:50:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1760927044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 msgr2=0x7f4cd006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1760927044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 0x7f4cd006d970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80097a0 tx=0x7f4cc802a180 comp rx=0 tx=0).stop 2024-05-04T07:50:57.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1760927044 shutdown_connections 2024-05-04T07:50:57.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1760927044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd006d4e0 0x7f4cd006d970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1760927044 >> v2:172.21.15.142:3300/0 conn(0x7f4cd00b3bf0 0x7f4cd015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1760927044 >> 172.21.15.136:0/1760927044 conn(0x7f4cd00d1b90 msgr2=0x7f4cd00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:57.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1760927044 shutdown_connections 2024-05-04T07:50:57.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.362+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1760927044 wait complete. 2024-05-04T07:50:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.363+0000 7f4cd5e00640 1 Processor -- start 2024-05-04T07:50:57.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.363+0000 7f4cd5e00640 1 -- start start 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd006d4e0 0x7f4cd0160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd00b4610 0x7f4cd01f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0159c80 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd006cce0 con 0x7f4cd006d4e0 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.364+0000 7f4cd5e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd006e790 con 0x7f4cd00b4610 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33520/0 (socket says 172.21.15.136:33520) 2024-05-04T07:50:57.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 -- 172.21.15.136:0/1857772959 learned_addr learned my addr 172.21.15.136:0/1857772959 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4ccea00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd006d4e0 0x7f4cd0160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4ccf400640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd00b4610 0x7f4cd01f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 -- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd00b4610 msgr2=0x7f4cd01f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd00b4610 0x7f4cd01f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 -- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd006d4e0 msgr2=0x7f4cd0160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd006d4e0 0x7f4cd0160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 -- 172.21.15.136:0/1857772959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd00af900 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.365+0000 7f4cce000640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.366+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8017070 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.366+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb800c9a0 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.366+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd00afbe0 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.366+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cd50 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.366+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd01f4e10 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.367+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd0069b10 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.368+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cb801a070 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.369+0000 7f4cc7400640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 0x7f4cac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.369+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4cb8097c50 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.369+0000 7f4ccea00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 0x7f4cac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.370+0000 7f4ccea00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 0x7f4cac078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00015a0 tx=0x7f4cc0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.373+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4cb80611e0 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.620+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4cd0161b90 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.621 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.621+0000 7f4cc7400640 1 -- 172.21.15.136:0/1857772959 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4cb8060ae0 con 0x7f4cd00b3bf0 2024-05-04T07:50:57.622 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:57.622 INFO:teuthology.orchestra.run.smithi136.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 msgr2=0x7f4cac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 0x7f4cac078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00015a0 tx=0x7f4cc0009040 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 msgr2=0x7f4cd014eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 shutdown_connections 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4cac0762d0 0x7f4cac078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd00b4610 0x7f4cd01f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd00b3bf0 0x7f4cd014eef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 --2- 172.21.15.136:0/1857772959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd006d4e0 0x7f4cd0160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 >> 172.21.15.136:0/1857772959 conn(0x7f4cd00d1b90 msgr2=0x7f4cd015f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:57.625 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 shutdown_connections 2024-05-04T07:50:57.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.624+0000 7f4cd5e00640 1 -- 172.21.15.136:0/1857772959 wait complete. 2024-05-04T07:50:57.644 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-04T07:50:57.645 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:57.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.845+0000 7f408d600640 1 Processor -- start 2024-05-04T07:50:57.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.845+0000 7f408d600640 1 -- start start 2024-05-04T07:50:57.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.846+0000 7f408d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408815f6c0 0x7f40880cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.846+0000 7f408d600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40880cc6e0 0x7f40880cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.846+0000 7f408d600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40880ceb20 con 0x7f40880afbc0 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.846+0000 7f408d600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f408815faa0 con 0x7f40880cc6e0 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.846+0000 7f408d600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f40880ce8d0 con 0x7f408815f6c0 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40880cc6e0 0x7f40880cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408815f6c0 0x7f40880cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40880cc6e0 0x7f40880cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33534/0 (socket says 172.21.15.136:33534) 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 -- 172.21.15.136:0/2170563748 learned_addr learned my addr 172.21.15.136:0/2170563748 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 -- 172.21.15.136:0/2170563748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408815f6c0 msgr2=0x7f40880cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 --2- 172.21.15.136:0/2170563748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408815f6c0 0x7f40880cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 -- 172.21.15.136:0/2170563748 >> v1:172.21.15.142:6789/0 conn(0x7f40880afbc0 legacy=0x7f4088072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.847+0000 7f4087400640 1 -- 172.21.15.136:0/2170563748 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40880cee00 con 0x7f40880cc6e0 2024-05-04T07:50:57.862 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f4087400640 1 --2- 172.21.15.136:0/2170563748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880cc6e0 0x7f40880cb560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f407000bb10 tx=0x7f407002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45c8f91e03baa57 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f4086a00640 1 -- 172.21.15.136:0/2170563748 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070032790 con 0x7f40880cc6e0 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f4086a00640 1 -- 172.21.15.136:0/2170563748 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4070038070 con 0x7f40880cc6e0 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f4086a00640 1 -- 172.21.15.136:0/2170563748 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4070032b50 con 0x7f40880cc6e0 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f408d600640 1 -- 172.21.15.136:0/2170563748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880cc6e0 msgr2=0x7f40880cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.849+0000 7f408d600640 1 --2- 172.21.15.136:0/2170563748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880cc6e0 0x7f40880cb560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f407000bb10 tx=0x7f407002c890 comp rx=0 tx=0).stop 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 -- 172.21.15.136:0/2170563748 shutdown_connections 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 --2- 172.21.15.136:0/2170563748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880cc6e0 0x7f40880cb560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 --2- 172.21.15.136:0/2170563748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f408815f6c0 0x7f40880cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 -- 172.21.15.136:0/2170563748 >> 172.21.15.136:0/2170563748 conn(0x7f40880d09d0 msgr2=0x7f40880d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 -- 172.21.15.136:0/2170563748 shutdown_connections 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.850+0000 7f408d600640 1 -- 172.21.15.136:0/2170563748 wait complete. 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.851+0000 7f408d600640 1 Processor -- start 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.852+0000 7f408d600640 1 -- start start 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.852+0000 7f408d600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.852+0000 7f408d600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40880cc6e0 0x7f408814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f408d600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408815f6c0 0x7f40880ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f408d600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40880cace0 con 0x7f40880afbc0 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f408d600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4088073d70 con 0x7f408815f6c0 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f408d600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f40880cae60 con 0x7f40880cc6e0 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33538/0 (socket says 172.21.15.136:33538) 2024-05-04T07:50:57.867 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 -- 172.21.15.136:0/4122294983 learned_addr learned my addr 172.21.15.136:0/4122294983 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 -- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40880cc6e0 msgr2=0x7f408814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40880cc6e0 0x7f408814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 -- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408815f6c0 msgr2=0x7f40880ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408815f6c0 0x7f40880ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 -- 172.21.15.136:0/4122294983 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408814f400 con 0x7f40880afbc0 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.853+0000 7f4087e00640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f407800e960 tx=0x7f407800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.854+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078017070 con 0x7f40880afbc0 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.854+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407800ca00 con 0x7f40880afbc0 2024-05-04T07:50:57.868 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.854+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40880c8da0 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.854+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407800cdf0 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.854+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40880c9360 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.855+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4088069400 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.856+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f407801a070 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.857+0000 7f407fe00640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 0x7f4064078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.857+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4078097a70 con 0x7f40880afbc0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.857+0000 7f4087400640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 0x7f4064078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:57.869 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.858+0000 7f4087400640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 0x7f4064078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4070037000 tx=0x7f4070008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:57.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:57.861+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f408814f400 con 0x7f40880afbc0 2024-05-04T07:50:58.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.090+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4088158930 con 0x7f40880afbc0 2024-05-04T07:50:58.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.091+0000 7f407fe00640 1 -- 172.21.15.136:0/4122294983 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f4078060ff0 con 0x7f40880afbc0 2024-05-04T07:50:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:58.092 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:58.092 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 msgr2=0x7f4064078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 0x7f4064078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4070037000 tx=0x7f4070008040 comp rx=0 tx=0).stop 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 msgr2=0x7f40880c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f407800e960 tx=0x7f407800ee20 comp rx=0 tx=0).stop 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 shutdown_connections 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f40640762d0 0x7f4064078790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f408815f6c0 0x7f40880ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f40880cc6e0 0x7f408814eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 --2- 172.21.15.136:0/4122294983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40880afbc0 0x7f40880c8460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.093+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 >> 172.21.15.136:0/4122294983 conn(0x7f40880d09d0 msgr2=0x7f40880b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:58.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.094+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 shutdown_connections 2024-05-04T07:50:58.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.094+0000 7f408d600640 1 -- 172.21.15.136:0/4122294983 wait complete. 2024-05-04T07:50:58.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:58.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.308+0000 7f1213200640 1 Processor -- start 2024-05-04T07:50:58.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.308+0000 7f1213200640 1 -- start start 2024-05-04T07:50:58.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1213200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 0x7f120c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1213200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1213200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120c0cc7c0 con 0x7f120c0cc320 2024-05-04T07:50:58.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1213200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f120c15bab0 con 0x7f120c0cb8e0 2024-05-04T07:50:58.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1213200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f120c073480 con 0x7f120c15b6d0 2024-05-04T07:50:58.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1203e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f120be00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 0x7f120c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1203e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:59078/0 (socket says 172.21.15.136:59078) 2024-05-04T07:50:58.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.310+0000 7f1203e00640 1 -- 172.21.15.136:0/1887319610 learned_addr learned my addr 172.21.15.136:0/1887319610 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:58.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.311+0000 7f120be00640 1 -- 172.21.15.136:0/1887319610 >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 msgr2=0x7f120c0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:58.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.311+0000 7f120be00640 1 --2- 172.21.15.136:0/1887319610 >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.311+0000 7f120be00640 1 -- 172.21.15.136:0/1887319610 >> v1:172.21.15.142:6789/0 conn(0x7f120c0cc320 legacy=0x7f120c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.311+0000 7f120be00640 1 -- 172.21.15.136:0/1887319610 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c073760 con 0x7f120c15b6d0 2024-05-04T07:50:58.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.311+0000 7f1203e00640 1 --2- 172.21.15.136:0/1887319610 >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.312+0000 7f120be00640 1 --2- 172.21.15.136:0/1887319610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 0x7f120c0cbde0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097a0 tx=0x7f11fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc5e3c78ac333afb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f120b400640 1 -- 172.21.15.136:0/1887319610 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc037070 con 0x7f120c15b6d0 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f120b400640 1 -- 172.21.15.136:0/1887319610 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11fc032440 con 0x7f120c15b6d0 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f120b400640 1 -- 172.21.15.136:0/1887319610 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc032810 con 0x7f120c15b6d0 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 -- 172.21.15.136:0/1887319610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 msgr2=0x7f120c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 --2- 172.21.15.136:0/1887319610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 0x7f120c0cbde0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097a0 tx=0x7f11fc02a180 comp rx=0 tx=0).stop 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 -- 172.21.15.136:0/1887319610 shutdown_connections 2024-05-04T07:50:58.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 --2- 172.21.15.136:0/1887319610 >> v2:172.21.15.142:3300/0 conn(0x7f120c0cb8e0 0x7f120c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 --2- 172.21.15.136:0/1887319610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c15b6d0 0x7f120c0cbde0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.313+0000 7f1213200640 1 -- 172.21.15.136:0/1887319610 >> 172.21.15.136:0/1887319610 conn(0x7f120c0d0c30 msgr2=0x7f120c0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.314+0000 7f1213200640 1 -- 172.21.15.136:0/1887319610 shutdown_connections 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.314+0000 7f1213200640 1 -- 172.21.15.136:0/1887319610 wait complete. 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.315+0000 7f1213200640 1 Processor -- start 2024-05-04T07:50:58.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.315+0000 7f1213200640 1 -- start start 2024-05-04T07:50:58.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 0x7f120c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120c15b6d0 0x7f120c158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f120c073f60 con 0x7f120c0cc320 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f120c073150 con 0x7f120c15b6d0 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1213200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f120c0740e0 con 0x7f120c0cb8e0 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1203e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1203e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33544/0 (socket says 172.21.15.136:33544) 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.316+0000 7f1203e00640 1 -- 172.21.15.136:0/1572470191 learned_addr learned my addr 172.21.15.136:0/1572470191 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f120be00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 0x7f120c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1211200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120c15b6d0 0x7f120c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 -- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 msgr2=0x7f120c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 0x7f120c0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 -- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120c15b6d0 msgr2=0x7f120c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120c15b6d0 0x7f120c158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 -- 172.21.15.136:0/1572470191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c15a3d0 con 0x7f120c0cc320 2024-05-04T07:50:58.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f120be00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 0x7f120c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:58.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1203e00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11f400e9d0 tx=0x7f11f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4017070 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f400ca60 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f400ce10 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.317+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120c15a6b0 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.318+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120c15ac70 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.319+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120c069400 con 0x7f120c0cc320 2024-05-04T07:50:58.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.320+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f11f401a070 con 0x7f120c0cc320 2024-05-04T07:50:58.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.320+0000 7f1208c00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 0x7f11e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.321+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f11f4097c60 con 0x7f120c0cc320 2024-05-04T07:50:58.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.321+0000 7f120be00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 0x7f11e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.321+0000 7f120be00640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 0x7f11e8078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.328+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f11f4061270 con 0x7f120c0cc320 2024-05-04T07:50:58.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.576+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f120c0cd3f0 con 0x7f120c0cc320 2024-05-04T07:50:58.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.577+0000 7f1208c00640 1 -- 172.21.15.136:0/1572470191 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f11f4060b70 con 0x7f120c0cc320 2024-05-04T07:50:58.578 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:58.578 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:58.578 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 msgr2=0x7f11e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 0x7f11e8078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc02e000 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 msgr2=0x7f120c1581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f11f400e9d0 tx=0x7f11f400ee90 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 shutdown_connections 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f11e80762d0 0x7f11e8078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f120c15b6d0 0x7f120c158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f120c0cc320 0x7f120c1581e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 --2- 172.21.15.136:0/1572470191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f120c0cb8e0 0x7f120c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.581 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 >> 172.21.15.136:0/1572470191 conn(0x7f120c0d0c30 msgr2=0x7f120c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 shutdown_connections 2024-05-04T07:50:58.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.580+0000 7f1213200640 1 -- 172.21.15.136:0/1572470191 wait complete. 2024-05-04T07:50:58.600 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:50:58.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.798+0000 7f6422800640 1 Processor -- start 2024-05-04T07:50:58.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.798+0000 7f6422800640 1 -- start start 2024-05-04T07:50:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f6422800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f641c06f5e0 0x7f641c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f6422800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 0x7f641c0711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f6422800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f641c073000 con 0x7f641c0716f0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f6422800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f641c073ef0 con 0x7f641c06f5e0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f6422800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f641c0732e0 con 0x7f641c06f9c0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f641b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f641c06f5e0 0x7f641c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f641b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f641c06f5e0 0x7f641c0cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33556/0 (socket says 172.21.15.136:33556) 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f641b400640 1 -- 172.21.15.136:0/1619915099 learned_addr learned my addr 172.21.15.136:0/1619915099 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.800+0000 7f641be00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f641c0716f0 0x7f641c06c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:38950/0 (socket says 172.21.15.136:38950) 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f6412a00640 1 --2- 172.21.15.136:0/1619915099 >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 0x7f641c0711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f641b400640 1 -- 172.21.15.136:0/1619915099 >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 msgr2=0x7f641c0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f641b400640 1 --2- 172.21.15.136:0/1619915099 >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 0x7f641c0711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f641b400640 1 -- 172.21.15.136:0/1619915099 >> v1:172.21.15.136:6789/0 conn(0x7f641c0716f0 legacy=0x7f641c06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f641b400640 1 -- 172.21.15.136:0/1619915099 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c0735c0 con 0x7f641c06f5e0 2024-05-04T07:50:58.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.801+0000 7f6412a00640 1 --2- 172.21.15.136:0/1619915099 >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 0x7f641c0711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:50:58.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.802+0000 7f641b400640 1 --2- 172.21.15.136:0/1619915099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c06f5e0 0x7f641c0cc310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f641c0cf840 tx=0x7f640c02a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199357e3ca916fcb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.802+0000 7f641aa00640 1 -- 172.21.15.136:0/1619915099 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c036070 con 0x7f641c06f5e0 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.802+0000 7f641aa00640 1 -- 172.21.15.136:0/1619915099 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640c031600 con 0x7f641c06f5e0 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.802+0000 7f641aa00640 1 -- 172.21.15.136:0/1619915099 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c0319d0 con 0x7f641c06f5e0 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 -- 172.21.15.136:0/1619915099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c06f5e0 msgr2=0x7f641c0cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 --2- 172.21.15.136:0/1619915099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c06f5e0 0x7f641c0cc310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f641c0cf840 tx=0x7f640c02a740 comp rx=0 tx=0).stop 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 -- 172.21.15.136:0/1619915099 shutdown_connections 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 --2- 172.21.15.136:0/1619915099 >> v2:172.21.15.142:3300/0 conn(0x7f641c06f9c0 0x7f641c0711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 --2- 172.21.15.136:0/1619915099 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c06f5e0 0x7f641c0cc310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 -- 172.21.15.136:0/1619915099 >> 172.21.15.136:0/1619915099 conn(0x7f641c0d1cc0 msgr2=0x7f641c0d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 -- 172.21.15.136:0/1619915099 shutdown_connections 2024-05-04T07:50:58.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.803+0000 7f6422800640 1 -- 172.21.15.136:0/1619915099 wait complete. 2024-05-04T07:50:58.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.805+0000 7f6422800640 1 Processor -- start 2024-05-04T07:50:58.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.805+0000 7f6422800640 1 -- start start 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f641c06f5e0 0x7f641c157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f641c06f9c0 0x7f641c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f641c06cab0 con 0x7f641c0716f0 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f641c073b80 con 0x7f641c06f9c0 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f6422800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f641c06cc30 con 0x7f641c06f5e0 2024-05-04T07:50:58.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f641be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f641be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33562/0 (socket says 172.21.15.136:33562) 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.806+0000 7f641be00640 1 -- 172.21.15.136:0/3811487597 learned_addr learned my addr 172.21.15.136:0/3811487597 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f6412a00640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f641c06f9c0 0x7f641c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641b400640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f641c06f5e0 0x7f641c157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 -- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f641c06f5e0 msgr2=0x7f641c157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f641c06f5e0 0x7f641c157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 -- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f641c06f9c0 msgr2=0x7f641c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f641c06f9c0 0x7f641c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:58.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 -- 172.21.15.136:0/3811487597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c0c7fa0 con 0x7f641c0716f0 2024-05-04T07:50:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f641be00640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f641400c400 tx=0x7f641400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140074e0 con 0x7f641c0716f0 2024-05-04T07:50:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6414007680 con 0x7f641c0716f0 2024-05-04T07:50:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140049e0 con 0x7f641c0716f0 2024-05-04T07:50:58.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.807+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c156f20 con 0x7f641c0716f0 2024-05-04T07:50:58.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.808+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c1574e0 con 0x7f641c0716f0 2024-05-04T07:50:58.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.809+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c069b10 con 0x7f641c0716f0 2024-05-04T07:50:58.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.810+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f641401a020 con 0x7f641c0716f0 2024-05-04T07:50:58.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.811+0000 7f6413e00640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 0x7f63f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:58.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.812+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6414097170 con 0x7f641c0716f0 2024-05-04T07:50:58.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.812+0000 7f641b400640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 0x7f63f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:58.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.813+0000 7f641b400640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 0x7f63f8078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f640c033000 tx=0x7f640c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:58.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:58.816+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64140606f0 con 0x7f641c0716f0 2024-05-04T07:50:59.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.007+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f641c160890 con 0x7f641c0716f0 2024-05-04T07:50:59.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.010+0000 7f6413e00640 1 -- 172.21.15.136:0/3811487597 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18574 (secure 0 0 0) 0x7f641405fff0 con 0x7f641c0716f0 2024-05-04T07:50:59.011 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:59.011 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":24,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:50:32.014017+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:50:59.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 msgr2=0x7f63f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 0x7f63f8078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f640c033000 tx=0x7f640c009000 comp rx=0 tx=0).stop 2024-05-04T07:50:59.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 msgr2=0x7f641c0d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f641400c400 tx=0x7f641400c8c0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 shutdown_connections 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63f80762d0 0x7f63f8078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f641c0716f0 0x7f641c0d1230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f641c06f9c0 0x7f641c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 --2- 172.21.15.136:0/3811487597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f641c06f5e0 0x7f641c157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.013+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 >> 172.21.15.136:0/3811487597 conn(0x7f641c0d1cc0 msgr2=0x7f641c0b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.014+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 shutdown_connections 2024-05-04T07:50:59.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.014+0000 7f6422800640 1 -- 172.21.15.136:0/3811487597 wait complete. 2024-05-04T07:50:59.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:50:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.229+0000 7fac61c00640 1 Processor -- start 2024-05-04T07:50:59.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.230+0000 7fac61c00640 1 -- start start 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.231+0000 7fac61c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac5c0d3460 0x7fac5c0d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.231+0000 7fac61c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac5c0b1c60 0x7fac5c0d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.231+0000 7fac61c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0d3d80 con 0x7fac5c0b49e0 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.231+0000 7fac61c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0b2170 con 0x7fac5c0d3460 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.231+0000 7fac61c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0b2430 con 0x7fac5c0b1c60 2024-05-04T07:50:59.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac5c0d3460 0x7fac5c0d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac5c0d3460 0x7fac5c0d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33570/0 (socket says 172.21.15.136:33570) 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 -- 172.21.15.136:0/2112761928 learned_addr learned my addr 172.21.15.136:0/2112761928 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5b400640 1 --2- 172.21.15.136:0/2112761928 >> v2:172.21.15.142:3300/0 conn(0x7fac5c0b1c60 0x7fac5c0d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 -- 172.21.15.136:0/2112761928 >> v2:172.21.15.142:3300/0 conn(0x7fac5c0b1c60 msgr2=0x7fac5c0d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 --2- 172.21.15.136:0/2112761928 >> v2:172.21.15.142:3300/0 conn(0x7fac5c0b1c60 0x7fac5c0d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 -- 172.21.15.136:0/2112761928 >> v1:172.21.15.142:6789/0 conn(0x7fac5c0b49e0 legacy=0x7fac5c0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:50:59.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.232+0000 7fac5be00640 1 -- 172.21.15.136:0/2112761928 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0b2710 con 0x7fac5c0d3460 2024-05-04T07:50:59.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.233+0000 7fac5be00640 1 --2- 172.21.15.136:0/2112761928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0d3460 0x7fac5c0d3840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06f490 tx=0x7fac4c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d892f2ac4cabda01 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.233+0000 7fac5aa00640 1 -- 172.21.15.136:0/2112761928 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c036070 con 0x7fac5c0d3460 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.233+0000 7fac5aa00640 1 -- 172.21.15.136:0/2112761928 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c031600 con 0x7fac5c0d3460 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.233+0000 7fac5aa00640 1 -- 172.21.15.136:0/2112761928 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0319d0 con 0x7fac5c0d3460 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 -- 172.21.15.136:0/2112761928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0d3460 msgr2=0x7fac5c0d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 --2- 172.21.15.136:0/2112761928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0d3460 0x7fac5c0d3840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac5c06f490 tx=0x7fac4c02a610 comp rx=0 tx=0).stop 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 -- 172.21.15.136:0/2112761928 shutdown_connections 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 --2- 172.21.15.136:0/2112761928 >> v2:172.21.15.142:3300/0 conn(0x7fac5c0b1c60 0x7fac5c0d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 --2- 172.21.15.136:0/2112761928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0d3460 0x7fac5c0d3840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 -- 172.21.15.136:0/2112761928 >> 172.21.15.136:0/2112761928 conn(0x7fac5c09e370 msgr2=0x7fac5c0d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 -- 172.21.15.136:0/2112761928 shutdown_connections 2024-05-04T07:50:59.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.234+0000 7fac61c00640 1 -- 172.21.15.136:0/2112761928 wait complete. 2024-05-04T07:50:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.236+0000 7fac61c00640 1 Processor -- start 2024-05-04T07:50:59.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.236+0000 7fac61c00640 1 -- start start 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c0b1c60 0x7fac5c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0d3460 0x7fac5c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0d5f00 con 0x7fac5c0b49e0 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0b2cd0 con 0x7fac5c0d3460 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0b4200 con 0x7fac5c0b1c60 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac5b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac5b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33576/0 (socket says 172.21.15.136:33576) 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac5b400640 1 -- 172.21.15.136:0/1657398621 learned_addr learned my addr 172.21.15.136:0/1657398621 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac5be00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c0b1c60 0x7fac5c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.237+0000 7fac61200640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0d3460 0x7fac5c0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 -- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c0b1c60 msgr2=0x7fac5c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c0b1c60 0x7fac5c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 -- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0d3460 msgr2=0x7fac5c0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0d3460 0x7fac5c0cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 -- 172.21.15.136:0/1657398621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0ce6e0 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac5b400640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d5f0 tx=0x7fac4400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440125f0 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac44019070 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440129d0 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c160b40 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.238+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c161cb0 con 0x7fac5c0b49e0 2024-05-04T07:50:59.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.240+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c074600 con 0x7fac5c0b49e0 2024-05-04T07:50:59.241 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.241+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac44012b70 con 0x7fac5c0b49e0 2024-05-04T07:50:59.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.242+0000 7fac53e00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 0x7fac38078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:50:59.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.242+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fac44097e10 con 0x7fac5c0b49e0 2024-05-04T07:50:59.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.242+0000 7fac5be00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 0x7fac38078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:50:59.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.243+0000 7fac5be00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 0x7fac38078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac4c033000 tx=0x7fac4c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:50:59.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.246+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac5c074600 con 0x7fac5c0b49e0 2024-05-04T07:50:59.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.494+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5c069400 con 0x7fac5c0b49e0 2024-05-04T07:50:59.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.495+0000 7fac53e00640 1 -- 172.21.15.136:0/1657398621 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7fac4409b030 con 0x7fac5c0b49e0 2024-05-04T07:50:59.495 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:50:59.495 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:50:59.496 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 msgr2=0x7fac38078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 0x7fac38078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac4c033000 tx=0x7fac4c009000 comp rx=0 tx=0).stop 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 msgr2=0x7fac5c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac4400d5f0 tx=0x7fac4400dab0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 shutdown_connections 2024-05-04T07:50:59.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fac380762d0 0x7fac38078790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0d3460 0x7fac5c0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac5c0b49e0 0x7fac5c0cb0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.497+0000 7fac61c00640 1 --2- 172.21.15.136:0/1657398621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c0b1c60 0x7fac5c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.498+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 >> 172.21.15.136:0/1657398621 conn(0x7fac5c09e370 msgr2=0x7fac5c0b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.498+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 shutdown_connections 2024-05-04T07:50:59.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:50:59.498+0000 7fac61c00640 1 -- 172.21.15.136:0/1657398621 wait complete. 2024-05-04T07:50:59.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-04T07:50:26.961726+0000', 'modified': '2024-05-04T07:50:49.129516+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6833/4269415671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 4269415671}, {'type': 'v1', 'addr': '172.21.15.142:6833', 'nonce': 4269415671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4267, 'qdb_cluster': [4267]} 2024-05-04T07:50:59.924 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-04T07:50:59.924 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-04T07:51:00.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.133+0000 7feeee200640 1 Processor -- start 2024-05-04T07:51:00.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.133+0000 7feeee200640 1 -- start start 2024-05-04T07:51:00.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.134+0000 7feeee200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feee8145ad0 0x7feee80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.134+0000 7feeee200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 0x7feee80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.134+0000 7feeee200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee80ccfa0 con 0x7feee80c6d60 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.134+0000 7feeee200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feee8145eb0 con 0x7feee8145ad0 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.134+0000 7feeee200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feee80cd280 con 0x7feee80cb340 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.135+0000 7feedfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 0x7feee80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.135 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.135+0000 7feeece00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feee8145ad0 0x7feee80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.135+0000 7feedfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 0x7feee80c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:33984/0 (socket says 172.21.15.136:33984) 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.135+0000 7feedfe00640 1 -- 172.21.15.136:0/2343329438 learned_addr learned my addr 172.21.15.136:0/2343329438 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.136+0000 7feeece00640 1 -- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 msgr2=0x7feee80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.136+0000 7feeece00640 1 --2- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 0x7feee80c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.136+0000 7feeece00640 1 -- 172.21.15.136:0/2343329438 >> v1:172.21.15.142:6789/0 conn(0x7feee80c6d60 legacy=0x7feee8160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.136+0000 7feeece00640 1 -- 172.21.15.136:0/2343329438 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee80d0460 con 0x7feee8145ad0 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.137+0000 7feeece00640 1 --2- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee8145ad0 0x7feee80c62e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e086dc43e9d11d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feee7e00640 1 -- 172.21.15.136:0/2343329438 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8037070 con 0x7feee8145ad0 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feee7e00640 1 -- 172.21.15.136:0/2343329438 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8032440 con 0x7feee8145ad0 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feee7e00640 1 -- 172.21.15.136:0/2343329438 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8032810 con 0x7feee8145ad0 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 -- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee8145ad0 msgr2=0x7feee80c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 --2- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee8145ad0 0x7feee80c62e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed802a180 comp rx=0 tx=0).stop 2024-05-04T07:51:00.139 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 -- 172.21.15.136:0/2343329438 shutdown_connections 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 --2- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee80cb340 0x7feee80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 --2- 172.21.15.136:0/2343329438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee8145ad0 0x7feee80c62e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 -- 172.21.15.136:0/2343329438 >> 172.21.15.136:0/2343329438 conn(0x7feee80cd490 msgr2=0x7feee80cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 -- 172.21.15.136:0/2343329438 shutdown_connections 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.138+0000 7feeee200640 1 -- 172.21.15.136:0/2343329438 wait complete. 2024-05-04T07:51:00.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.140+0000 7feeee200640 1 Processor -- start 2024-05-04T07:51:00.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.140+0000 7feeee200640 1 -- start start 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee80cb340 0x7feee806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee8145ad0 0x7feee813f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feee80ccd40 con 0x7feee80c6d60 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feee80ccbc0 con 0x7feee80cb340 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.141+0000 7feeee200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feee80cf5f0 con 0x7feee8145ad0 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.142 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33586/0 (socket says 172.21.15.136:33586) 2024-05-04T07:51:00.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 -- 172.21.15.136:0/3373975452 learned_addr learned my addr 172.21.15.136:0/3373975452 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeed800640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee8145ad0 0x7feee813f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feedfe00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee80cb340 0x7feee806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 -- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee8145ad0 msgr2=0x7feee813f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee8145ad0 0x7feee813f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 -- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee80cb340 msgr2=0x7feee806ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee80cb340 0x7feee806ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.142+0000 7feeece00640 1 -- 172.21.15.136:0/3373975452 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee814dfe0 con 0x7feee80c6d60 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feeece00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feed8035040 tx=0x7feed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feee5600640 1 -- 172.21.15.136:0/3373975452 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8037040 con 0x7feee80c6d60 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feee5600640 1 -- 172.21.15.136:0/3373975452 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8030500 con 0x7feee80c6d60 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feee5600640 1 -- 172.21.15.136:0/3373975452 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8030910 con 0x7feee80c6d60 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee814e2c0 con 0x7feee80c6d60 2024-05-04T07:51:00.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.143+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee814e880 con 0x7feee80c6d60 2024-05-04T07:51:00.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.146+0000 7feee5600640 1 -- 172.21.15.136:0/3373975452 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feed8044020 con 0x7feee80c6d60 2024-05-04T07:51:00.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.146+0000 7feee5600640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 0x7feec4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.147+0000 7feee5600640 1 -- 172.21.15.136:0/3373975452 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feed80b7c60 con 0x7feee80c6d60 2024-05-04T07:51:00.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.147+0000 7feef27e6740 1 Processor -- start 2024-05-04T07:51:00.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.147+0000 7feedfe00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 0x7feec4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.147+0000 7feef27e6740 1 -- start start 2024-05-04T07:51:00.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feedfe00640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 0x7feec4078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feee81f8490 tx=0x7feed0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a210478a0 0x561a2104b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 0x561a2104bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561a20fb0790 con 0x561a2104ca10 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561a20f55f20 con 0x561a2104bb50 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x561a20fac750 con 0x561a210478a0 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33598/0 (socket says 172.21.15.136:33598) 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.148+0000 7feeece00640 1 -- 172.21.15.136:0/3744272339 learned_addr learned my addr 172.21.15.136:0/3744272339 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 -- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a210478a0 msgr2=0x561a2104b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feedfe00640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a210478a0 0x561a2104b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeed800640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 0x561a2104bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a210478a0 0x561a2104b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 -- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 msgr2=0x561a2104bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 0x561a2104bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 -- 172.21.15.136:0/3744272339 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a20cc22d0 con 0x561a2104ca10 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeed800640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 0x561a2104bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feeece00640 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feed80b5db0 tx=0x7feed80804c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9ecfde6a484702 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feedd600640 1 -- 172.21.15.136:0/3744272339 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed809a070 con 0x561a2104ca10 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feedd600640 1 -- 172.21.15.136:0/3744272339 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8089290 con 0x561a2104ca10 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.149+0000 7feedd600640 1 -- 172.21.15.136:0/3744272339 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80896b0 con 0x561a2104ca10 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 -- 172.21.15.136:0/3744272339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 msgr2=0x561a2104cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feed80b5db0 tx=0x7feed80804c0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 -- 172.21.15.136:0/3744272339 shutdown_connections 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104bb50 0x561a2104bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a210478a0 0x561a2104b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 --2- 172.21.15.136:0/3744272339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104ca10 0x561a2104cdf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 -- 172.21.15.136:0/3744272339 >> 172.21.15.136:0/3744272339 conn(0x561a21049b10 msgr2=0x561a210925d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 -- 172.21.15.136:0/3744272339 shutdown_connections 2024-05-04T07:51:00.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.150+0000 7feef27e6740 1 -- 172.21.15.136:0/3744272339 wait complete. 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.151+0000 7feef27e6740 1 -- start start 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.151+0000 7feef27e6740 1 Processor -- start 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 0x561a21066ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a21095d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561a20fb0790 con 0x561a21096260 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561a20f699c0 con 0x561a2104ca10 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x561a210785a0 con 0x561a2104bb50 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feef27e6740 10 client.0 _ll_register_callbacks cb 0x561a20f36120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feeed800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feeed800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33602/0 (socket says 172.21.15.136:33602) 2024-05-04T07:51:00.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.152+0000 7feeed800640 1 -- 172.21.15.136:0/13659119 learned_addr learned my addr 172.21.15.136:0/13659119 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeece00640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 0x561a21066ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feedfe00640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a21095d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 -- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 msgr2=0x561a21066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 0x561a21066ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 -- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 msgr2=0x561a21095d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a21095d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 -- 172.21.15.136:0/13659119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a20d8c6b0 con 0x561a21096260 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeece00640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 0x561a21066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feeed800640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feee000f4b0 tx=0x7feee000f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492bdab7979a7132 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feed6000640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0017020 con 0x561a21096260 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feee0003b80 con 0x561a21096260 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.153+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feed8089290 con 0x561a21096260 2024-05-04T07:51:00.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feee0021050 con 0x561a21096260 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 10 client.4695 fetch_fsmap learned FSMap version 9 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561a21068160 con 0x561a21096260 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8089290 con 0x561a21096260 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7feee0024020 con 0x561a21096260 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 10 client.4695 fetch_fsmap finished waiting for FSMap version 9 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 20 client.4695 populate_metadata read hostname 'smithi136' 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a21068c70 0x561a21093ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 4 client.4695 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.154+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 --> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a20fbe3a0 con 0x561a21068c70 2024-05-04T07:51:00.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.155+0000 7feeece00640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a21068c70 0x561a21093ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.156+0000 7feeece00640 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a21068c70 0x561a21093ed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534b31dd8e421e90 server_cookie=9b61906cd71df16f in_seq=0 out_seq=0 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.156+0000 7feed6000640 10 client.4695 ms_handle_connect on v2:172.21.15.142:6832/4269415671 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.158+0000 7feed6000640 1 -- 172.21.15.136:0/13659119 <== mds.0 v2:172.21.15.142:6832/4269415671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a20fbe3a0 con 0x561a21068c70 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.158+0000 7feed6000640 10 client.4695 handle_command_reply: tid=0 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 client.4695 shutdown 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 msgr2=0x561a21090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feee000f4b0 tx=0x7feee000f970 comp rx=0 tx=0).stop 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 shutdown_connections 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a21068c70 0x561a21093ed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a21096260 0x561a21090d60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a21095d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 --2- 172.21.15.136:0/13659119 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104bb50 0x561a21066ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 >> 172.21.15.136:0/13659119 conn(0x561a210478a0 msgr2=0x561a21077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feed6000640 0 client.4695 ms_handle_reset on v2:172.21.15.142:6832/4269415671 2024-05-04T07:51:00.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 shutdown_connections 2024-05-04T07:51:00.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 1 -- 172.21.15.136:0/13659119 wait complete. 2024-05-04T07:51:00.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.159+0000 7feef27e6740 20 client.4695 trim_cache size 0 max 16384 2024-05-04T07:51:00.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.185+0000 7feef27e6740 1 Processor -- start 2024-05-04T07:51:00.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.185+0000 7feef27e6740 1 -- start start 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104ca10 0x561a21077980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a21096260 0x561a21090960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feee8201bb0 con 0x561a2104bb50 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feee80b00f0 con 0x561a21096260 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feee8201560 con 0x561a2104ca10 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.186+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33604/0 (socket says 172.21.15.136:33604) 2024-05-04T07:51:00.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 -- 172.21.15.136:0/504376682 learned_addr learned my addr 172.21.15.136:0/504376682 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 -- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104ca10 msgr2=0x561a21077980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104ca10 0x561a21077980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 -- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a21096260 msgr2=0x561a21090960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeed800640 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a21096260 0x561a21090960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a21096260 0x561a21090960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 -- 172.21.15.136:0/504376682 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a210a5d70 con 0x561a2104bb50 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feeece00640 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed8048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab1326544049a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feedcc00640 1 -- 172.21.15.136:0/504376682 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed809a040 con 0x561a2104bb50 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.187+0000 7feedcc00640 1 -- 172.21.15.136:0/504376682 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8089290 con 0x561a2104bb50 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feedcc00640 1 -- 172.21.15.136:0/504376682 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80896b0 con 0x561a2104bb50 2024-05-04T07:51:00.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 -- 172.21.15.136:0/504376682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 msgr2=0x561a21066cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed8048000 comp rx=0 tx=0).stop 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 -- 172.21.15.136:0/504376682 shutdown_connections 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a21096260 0x561a21090960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a2104ca10 0x561a21077980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 --2- 172.21.15.136:0/504376682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a21066cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.188+0000 7feef27e6740 1 -- 172.21.15.136:0/504376682 >> 172.21.15.136:0/504376682 conn(0x561a210478a0 msgr2=0x561a210a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.189+0000 7feef27e6740 1 -- 172.21.15.136:0/504376682 shutdown_connections 2024-05-04T07:51:00.190 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.189+0000 7feef27e6740 1 -- 172.21.15.136:0/504376682 wait complete. 2024-05-04T07:51:00.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.189+0000 7feef27e6740 1 -- start start 2024-05-04T07:51:00.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.189+0000 7feef27e6740 1 Processor -- start 2024-05-04T07:51:00.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.190+0000 7feef27e6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.190+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a210b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.190+0000 7feef27e6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 0x561a21077980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feef27e6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561a21068af0 con 0x561a2104bb50 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561a210948f0 con 0x561a2104ca10 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feef27e6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x561a21069140 con 0x561a21096260 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feef27e6740 10 client.0 _ll_register_callbacks cb 0x7feee806d810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33618/0 (socket says 172.21.15.136:33618) 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 -- 172.21.15.136:0/3194172830 learned_addr learned my addr 172.21.15.136:0/3194172830 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeed800640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 0x561a21077980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feedfe00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a210b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 -- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 msgr2=0x561a21077980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 0x561a21077980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 -- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 msgr2=0x561a210b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a210b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 -- 172.21.15.136:0/3194172830 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a2106a160 con 0x561a2104bb50 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeed800640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 0x561a21077980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feeece00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feed807dde0 tx=0x7feed802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273769e4b1353513 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.191+0000 7feed6000640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed80896b0 con 0x561a2104bb50 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feed807fdd0 con 0x561a2104bb50 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feed8089290 con 0x561a2104bb50 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7feed80a1050 con 0x561a2104bb50 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feef27e6740 10 client.4701 fetch_fsmap learned FSMap version 9 2024-05-04T07:51:00.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561a21065710 con 0x561a2104bb50 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8089290 con 0x561a2104bb50 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.192+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7feed803a070 con 0x561a2104bb50 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 10 client.4701 fetch_fsmap finished waiting for FSMap version 9 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 10 client.4701 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 20 client.4701 populate_metadata read hostname 'smithi136' 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a210b5890 0x561a21077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 4 client.4701 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T07:51:00.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 --> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] -- command(tid 0: {"prefix": "status"}) -- 0x561a20fb8210 con 0x561a210b5890 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.193+0000 7feedfe00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a210b5890 0x561a21077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.194+0000 7feedfe00640 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a210b5890 0x561a21077ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=733e7c1c49943432 server_cookie=34f217e5b0365418 in_seq=0 out_seq=0 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.194+0000 7feed6000640 10 client.4701 ms_handle_connect on v2:172.21.15.142:6832/4269415671 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feed6000640 1 -- 172.21.15.136:0/3194172830 <== mds.0 v2:172.21.15.142:6832/4269415671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x561a20fb8210 con 0x561a210b5890 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feed6000640 10 client.4701 handle_command_reply: tid=0 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 client.4701 shutdown 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 msgr2=0x561a210a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feed807dde0 tx=0x7feed802a180 comp rx=0 tx=0).stop 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 shutdown_connections 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561a21096260 0x561a21077980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561a2104ca10 0x561a210b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.142:6832/4269415671,v1:172.21.15.142:6833/4269415671] conn(0x561a210b5890 0x561a21077ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 --2- 172.21.15.136:0/3194172830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561a2104bb50 0x561a210a50a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feed6000640 0 client.4701 ms_handle_reset on v2:172.21.15.142:6832/4269415671 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 >> 172.21.15.136:0/3194172830 conn(0x561a210478a0 msgr2=0x561a21066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 shutdown_connections 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 1 -- 172.21.15.136:0/3194172830 wait complete. 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.195+0000 7feef27e6740 20 client.4701 trim_cache size 0 max 16384 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "9ecc10c5-f8dd-4dd0-88f7-548a507c724d", 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4267, 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-05-04T07:51:00.198 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 32.706823360999998, 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 9, 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 24, 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 24, 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 38.758330366000003 2024-05-04T07:51:00.199 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 msgr2=0x7feec4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 0x7feec4078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feee81f8490 tx=0x7feed0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 msgr2=0x7feee813d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feed8035040 tx=0x7feed80046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 shutdown_connections 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feec40762d0 0x7feec4078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feee8145ad0 0x7feee813f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee80cb340 0x7feee806ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 --2- 172.21.15.136:0/3373975452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee80c6d60 0x7feee813d820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 >> 172.21.15.136:0/3373975452 conn(0x7feee80cd490 msgr2=0x7feee8073410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 shutdown_connections 2024-05-04T07:51:00.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:00.196+0000 7feeee200640 1 -- 172.21.15.136:0/3373975452 wait complete. 2024-05-04T07:51:00.214 INFO:teuthology.run_tasks:Running task sequential... 2024-05-04T07:51:00.226 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-04T07:51:00.226 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-04T07:51:00.226 INFO:teuthology.task.print:Enabling mgr modules 2024-05-04T07:51:00.226 INFO:teuthology.run_tasks:Running task kclient... 2024-05-04T07:51:00.249 INFO:tasks.kclient:Mounting kernel clients... 2024-05-04T07:51:00.249 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-04T07:51:00.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.249 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:51:00.303 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-04T07:51:00.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-04T07:51:00.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-05-04T07:51:00.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.513 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:51:00.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-05-04T07:51:00.685 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-05-04T07:51:00.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:51:00.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.689 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:51:00.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-05-04T07:51:00.836 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-05-04T07:51:00.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:51:00.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.840 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:51:00.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:00.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-05-04T07:51:00.969 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-05-04T07:51:00.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:51:00.972 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-04T07:51:00.972 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T07:51:00.972 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:00.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:51:01.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.182+0000 7f8c60e00640 1 Processor -- start 2024-05-04T07:51:01.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.182+0000 7f8c60e00640 1 -- start start 2024-05-04T07:51:01.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.183+0000 7f8c60e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.183+0000 7f8c60e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c5c0ce8d0 0x7f8c5c071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c60e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5c072290 con 0x7f8c5c06f220 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c60e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c0d1840 con 0x7f8c5c0afc80 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c60e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8c5c0cee00 con 0x7f8c5c0ce8d0 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33624/0 (socket says 172.21.15.136:33624) 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 -- 172.21.15.136:0/3037487794 learned_addr learned my addr 172.21.15.136:0/3037487794 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:01.186 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5aa00640 1 --2- 172.21.15.136:0/3037487794 >> v2:172.21.15.142:3300/0 conn(0x7f8c5c0ce8d0 0x7f8c5c071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 -- 172.21.15.136:0/3037487794 >> v2:172.21.15.142:3300/0 conn(0x7f8c5c0ce8d0 msgr2=0x7f8c5c071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:01.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 --2- 172.21.15.136:0/3037487794 >> v2:172.21.15.142:3300/0 conn(0x7f8c5c0ce8d0 0x7f8c5c071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.184+0000 7f8c5b400640 1 -- 172.21.15.136:0/3037487794 >> v1:172.21.15.142:6789/0 conn(0x7f8c5c06f220 legacy=0x7f8c5c06f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:01.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.185+0000 7f8c5b400640 1 -- 172.21.15.136:0/3037487794 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c0cf0e0 con 0x7f8c5c0afc80 2024-05-04T07:51:01.187 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.186+0000 7f8c5b400640 1 --2- 172.21.15.136:0/3037487794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0711a0 tx=0x7f8c4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63a063fddfc5d34 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:01.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.186+0000 7f8c5a000640 1 -- 172.21.15.136:0/3037487794 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c037070 con 0x7f8c5c0afc80 2024-05-04T07:51:01.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.186+0000 7f8c5a000640 1 -- 172.21.15.136:0/3037487794 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c032440 con 0x7f8c5c0afc80 2024-05-04T07:51:01.188 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.186+0000 7f8c5a000640 1 -- 172.21.15.136:0/3037487794 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c032810 con 0x7f8c5c0afc80 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 -- 172.21.15.136:0/3037487794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 msgr2=0x7f8c5c0cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3037487794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0711a0 tx=0x7f8c4c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 -- 172.21.15.136:0/3037487794 shutdown_connections 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3037487794 >> v2:172.21.15.142:3300/0 conn(0x7f8c5c0ce8d0 0x7f8c5c071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3037487794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cfea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 -- 172.21.15.136:0/3037487794 >> 172.21.15.136:0/3037487794 conn(0x7f8c5c0d09d0 msgr2=0x7f8c5c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 -- 172.21.15.136:0/3037487794 shutdown_connections 2024-05-04T07:51:01.189 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.187+0000 7f8c60e00640 1 -- 172.21.15.136:0/3037487794 wait complete. 2024-05-04T07:51:01.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.189+0000 7f8c60e00640 1 Processor -- start 2024-05-04T07:51:01.191 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.189+0000 7f8c60e00640 1 -- start start 2024-05-04T07:51:01.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5c06f220 0x7f8c5c1e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5c0ce8d0 0x7f8c5c1e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.193 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c0cf980 con 0x7f8c5c0afc80 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c0cf6a0 con 0x7f8c5c06f220 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.190+0000 7f8c60e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5c0b0060 con 0x7f8c5c0ce8d0 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33634/0 (socket says 172.21.15.136:33634) 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 -- 172.21.15.136:0/3472544805 learned_addr learned my addr 172.21.15.136:0/3472544805 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5b400640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5c06f220 0x7f8c5c1e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5be00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5c0ce8d0 0x7f8c5c1e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 -- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5c0ce8d0 msgr2=0x7f8c5c1e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5c0ce8d0 0x7f8c5c1e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 -- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5c06f220 msgr2=0x7f8c5c1e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5c06f220 0x7f8c5c1e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.191+0000 7f8c5aa00640 1 -- 172.21.15.136:0/3472544805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c0cb8e0 con 0x7f8c5c0afc80 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c5aa00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d830 tx=0x7f8c4800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:01.194 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800b6c0 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48019070 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800ba80 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c1e65e0 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.192+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c1e6ba0 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.193+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5c069400 con 0x7f8c5c0afc80 2024-05-04T07:51:01.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.194+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c4801e460 con 0x7f8c5c0afc80 2024-05-04T07:51:01.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.195+0000 7f8c53400640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 0x7f8c3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:01.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.195+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c48097f90 con 0x7f8c5c0afc80 2024-05-04T07:51:01.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.195+0000 7f8c5b400640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 0x7f8c3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:01.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.196+0000 7f8c5b400640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 0x7f8c3c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c034000 tx=0x7f8c4c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:01.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.200+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c48061640 con 0x7f8c5c0afc80 2024-05-04T07:51:01.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.449+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c5c0b6470 con 0x7f8c5c0afc80 2024-05-04T07:51:01.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.450+0000 7f8c53400640 1 -- 172.21.15.136:0/3472544805 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f8c48060f40 con 0x7f8c5c0afc80 2024-05-04T07:51:01.451 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 msgr2=0x7f8c3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 0x7f8c3c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c034000 tx=0x7f8c4c02e000 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 msgr2=0x7f8c5c0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d830 tx=0x7f8c4800dcf0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 shutdown_connections 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8c3c0762d0 0x7f8c3c078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c5c0ce8d0 0x7f8c5c1e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c5c0afc80 0x7f8c5c0cb3a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 --2- 172.21.15.136:0/3472544805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c5c06f220 0x7f8c5c1e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:01.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.452+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 >> 172.21.15.136:0/3472544805 conn(0x7f8c5c0d09d0 msgr2=0x7f8c5c0b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:01.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.453+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 shutdown_connections 2024-05-04T07:51:01.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01.453+0000 7f8c60e00640 1 -- 172.21.15.136:0/3472544805 wait complete. 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:01.474 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T07:51:01.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T07:51:01.475 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:51:01.475 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-04T07:51:01.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:01.475 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:01.527 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42590sec preferred_lft 42590sec 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-05-04T07:51:01.528 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:01.530 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-04T07:51:01.530 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:01.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:01.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:01.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:01.774 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:51:01.833 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-05-04T07:51:01.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:01.836 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-05-04T07:51:01.881 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-05-04T07:51:01.881 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:51:01.881 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:51:01.881 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:51:01.881 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:51:01.882 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:02.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:02.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:02.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:02.132 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:51:02.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:02.181 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-05-04T07:51:02.233 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:02.233 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:02.233 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T07:51:02.233 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-04T07:51:02.233 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:02.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:02.400 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:02.410 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-04T07:51:02.410 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-04T07:51:02.411 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:02.513 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:02.665 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:02.674 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:02.674 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:02.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-05-04T07:51:02.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-05-04T07:51:02.674 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:02.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:02.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:02.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:02.869 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:02.918 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-04T07:51:02.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:02.918 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:02.971 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-04T07:51:02.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:02.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:03.107 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:03.107 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-05-04T07:51:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 0@9ecc10c5-f8dd-4dd0-88f7-548a507c724d.cephfs=/ 2024-05-04T07:51:03.832 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.136:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-05-04T07:51:03.837 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-04T07:51:03.837 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-05-04T07:51:03.837 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-04T07:51:03.837 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-05-04T07:51:03.837 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-04T07:51:03.843 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-04T07:51:03.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:03.843 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:03.926 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:04.035 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:04.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:04.051 INFO:teuthology.orchestra.run.smithi136.stdout:client4549 2024-05-04T07:51:04.051 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:04.051 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:04.101 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:04.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:04.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:04.265 INFO:teuthology.orchestra.run.smithi136.stdout:client4549 2024-05-04T07:51:04.266 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:04.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:04.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:04.387 INFO:teuthology.orchestra.run.smithi136.stdout:client4549 2024-05-04T07:51:04.387 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9ecc10c5-f8dd-4dd0-88f7-548a507c724d.client4549/status') 2024-05-04T07:51:04.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:04.514 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4549 (3)172.21.15.136:0/2365376479 2024-05-04T07:51:04.514 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-05-04T07:51:04.514 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-05-04T07:51:04.514 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-05-04T07:51:04.514 INFO:teuthology.orchestra.run.smithi136.stderr:71 bytes copied, 6.34e-05 s, 1.1 MB/s 2024-05-04T07:51:04.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:04.526 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-04T07:51:04.526 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T07:51:04.526 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-04T07:51:04.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:51:04.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.723+0000 7fca27e00640 1 Processor -- start 2024-05-04T07:51:04.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.723+0000 7fca27e00640 1 -- start start 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca280d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fca280b31f0 0x7fca280b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca280d3d80 con 0x7fca280b1c60 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fca280b2170 con 0x7fca280b31f0 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fca280b2430 con 0x7fca280d3460 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca26000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fca280b1c60 0x7fca280d59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:44450/0 (socket says 172.21.15.136:44450) 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca26000640 1 -- 172.21.15.136:0/3172484530 learned_addr learned my addr 172.21.15.136:0/3172484530 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca26a00640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca280d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.725+0000 7fca27400640 1 --2- 172.21.15.136:0/3172484530 >> v2:172.21.15.142:3300/0 conn(0x7fca280b31f0 0x7fca280b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537245520 0 0) 0x7fca280d3d80 con 0x7fca280b1c60 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca0c003520 con 0x7fca280b1c60 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1562022278 0 0) 0x7fca0c003520 con 0x7fca280b1c60 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 msgr2=0x7fca280d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca280d3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 >> v2:172.21.15.142:3300/0 conn(0x7fca280b31f0 msgr2=0x7fca280b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:04.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 --2- 172.21.15.136:0/3172484530 >> v2:172.21.15.142:3300/0 conn(0x7fca280b31f0 0x7fca280b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca280b2710 con 0x7fca280b1c60 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fca100016f0 con 0x7fca280b1c60 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 >> v1:172.21.15.136:6789/0 conn(0x7fca280b1c60 legacy=0x7fca280d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c003a00 0x7fca0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca280b2170 con 0x7fca0c004800 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca280b2430 con 0x7fca0c003a00 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.726+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c00ba40 con 0x7fca280d3460 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26a00640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c003a00 0x7fca0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca27400640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 -- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 msgr2=0x7fca0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:04.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca280d3460 0x7fca0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 -- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c003a00 msgr2=0x7fca0c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:04.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca0c003a00 0x7fca0c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.727+0000 7fca26000640 1 -- 172.21.15.136:0/3172484530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c003520 con 0x7fca0c004800 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.728+0000 7fca26000640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca10007fd0 tx=0x7fca0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793546444c5d21e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.728+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007d50 con 0x7fca0c004800 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.728+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10005af0 con 0x7fca0c004800 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.728+0000 7fca25600640 1 -- 172.21.15.136:0/3172484530 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007070 con 0x7fca0c004800 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 -- 172.21.15.136:0/3172484530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 msgr2=0x7fca0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 --2- 172.21.15.136:0/3172484530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca10007fd0 tx=0x7fca0c005830 comp rx=0 tx=0).stop 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27400640 1 -- 172.21.15.136:0/3172484530 reap_dead start 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 -- 172.21.15.136:0/3172484530 shutdown_connections 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 -- 172.21.15.136:0/3172484530 >> 172.21.15.136:0/3172484530 conn(0x7fca2809e370 msgr2=0x7fca280d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 -- 172.21.15.136:0/3172484530 shutdown_connections 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.729+0000 7fca27e00640 1 -- 172.21.15.136:0/3172484530 wait complete. 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.731+0000 7fca27e00640 1 Processor -- start 2024-05-04T07:51:04.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.731+0000 7fca27e00640 1 -- start start 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 0x7fca2815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 0x7fca280cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca28163ae0 con 0x7fca0c004800 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca280b2cd0 con 0x7fca280ccb80 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca27e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fca28163c60 con 0x7fca2815d0d0 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca26a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca26a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60790/0 (socket says 172.21.15.136:60790) 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.732+0000 7fca26a00640 1 -- 172.21.15.136:0/247666561 learned_addr learned my addr 172.21.15.136:0/247666561 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26000640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 0x7fca2815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca27400640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 0x7fca280cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 -- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 msgr2=0x7fca2815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 0x7fca2815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 -- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 msgr2=0x7fca280cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 0x7fca280cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 -- 172.21.15.136:0/247666561 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca280cd790 con 0x7fca0c004800 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26000640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 0x7fca2815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca27400640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 0x7fca280cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca26a00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca18011570 tx=0x7fca18011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18015930 con 0x7fca0c004800 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca18015ad0 con 0x7fca0c004800 2024-05-04T07:51:04.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1800f460 con 0x7fca0c004800 2024-05-04T07:51:04.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca280cda70 con 0x7fca0c004800 2024-05-04T07:51:04.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.733+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca280ce030 con 0x7fca0c004800 2024-05-04T07:51:04.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.734+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca28069400 con 0x7fca0c004800 2024-05-04T07:51:04.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.736+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca1800f600 con 0x7fca0c004800 2024-05-04T07:51:04.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.737+0000 7fca1ea00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 0x7fca04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:04.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.737+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fca180981b0 con 0x7fca0c004800 2024-05-04T07:51:04.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.737+0000 7fca26000640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 0x7fca04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:04.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.738+0000 7fca26000640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 0x7fca04078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca10032000 tx=0x7fca1002d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:04.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.742+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca18019030 con 0x7fca0c004800 2024-05-04T07:51:04.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.986+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca28160150 con 0x7fca0c004800 2024-05-04T07:51:04.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.987+0000 7fca1ea00640 1 -- 172.21.15.136:0/247666561 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fca18061730 con 0x7fca0c004800 2024-05-04T07:51:04.989 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 msgr2=0x7fca04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 0x7fca04078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca10032000 tx=0x7fca1002d000 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 msgr2=0x7fca28154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca18011570 tx=0x7fca18011a30 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 shutdown_connections 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fca040762d0 0x7fca04078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca280ccb80 0x7fca280cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2815d0d0 0x7fca2815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 --2- 172.21.15.136:0/247666561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca0c004800 0x7fca28154ba0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:04.992 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 >> 172.21.15.136:0/247666561 conn(0x7fca2809e370 msgr2=0x7fca280b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:04.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.990+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 shutdown_connections 2024-05-04T07:51:04.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:04.991+0000 7fca27e00640 1 -- 172.21.15.136:0/247666561 wait complete. 2024-05-04T07:51:05.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T07:51:05.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:51:05.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-04T07:51:05.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.011 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:05.060 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether ea:11:4a:5a:6e:9d brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::48ba:3fff:fe54:7fbb/64 scope link 2024-05-04T07:51:05.061 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.062 INFO:teuthology.orchestra.run.smithi136.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-04T07:51:05.062 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether ea:11:4a:5a:6e:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T07:51:05.062 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::e811:4aff:fe5a:6e9d/64 scope link 2024-05-04T07:51:05.062 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.063 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:51:05.139 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-05-04T07:51:05.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.143 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-05-04T07:51:05.199 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-05-04T07:51:05.199 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:51:05.199 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:51:05.199 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:51:05.199 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:51:05.199 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:05.199 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:05.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:51:05.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:51:05.200 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:51:05.200 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:05.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:05.404 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:05.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.414 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:51:05.465 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-04T07:51:05.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.466 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-05-04T07:51:05.516 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-04T07:51:05.518 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:05.518 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:05.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-04T07:51:05.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-04T07:51:05.518 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:05.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:05.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:05.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.703 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 72:0b:6b:38:4d:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-04T07:51:05.785 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-04T07:51:05.786 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.786 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::700b:6bff:fe38:4de5/64 scope link 2024-05-04T07:51:05.786 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:05.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-04T07:51:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:05.867 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:05.867 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 72:0b:6b:38:4d:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::700b:6bff:fe38:4de5/64 scope link 2024-05-04T07:51:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:05.871 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-04T07:51:05.871 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:05.871 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-04T07:51:05.872 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:05.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:06.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:06.136 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:06.136 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:06.136 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2024-05-04T07:51:06.136 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2024-05-04T07:51:06.137 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:06.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:06.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:06.336 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:06.337 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-04T07:51:06.383 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-04T07:51:06.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:06.383 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-04T07:51:06.476 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-04T07:51:06.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:06.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:06.604 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:06.604 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:06.638 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:06.638 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:06.638 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-05-04T07:51:06.638 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 2@9ecc10c5-f8dd-4dd0-88f7-548a507c724d.cephfs=/ 2024-05-04T07:51:06.639 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.136:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-05-04T07:51:06.640 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-04T07:51:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-05-04T07:51:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-04T07:51:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-05-04T07:51:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-04T07:51:06.643 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-04T07:51:06.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:06.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-04T07:51:06.711 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:06.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:06.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:06.822 INFO:teuthology.orchestra.run.smithi136.stdout:client4451 2024-05-04T07:51:06.822 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:06.822 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:06.865 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:07.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:07.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:07.027 INFO:teuthology.orchestra.run.smithi136.stdout:client4451 2024-05-04T07:51:07.027 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:07.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:07.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:07.133 INFO:teuthology.orchestra.run.smithi136.stdout:client4451 2024-05-04T07:51:07.133 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9ecc10c5-f8dd-4dd0-88f7-548a507c724d.client4451/status') 2024-05-04T07:51:07.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:07.251 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4451 (3)172.21.15.136:0/1859351255 2024-05-04T07:51:07.251 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-05-04T07:51:07.252 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-05-04T07:51:07.252 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-05-04T07:51:07.252 INFO:teuthology.orchestra.run.smithi136.stderr:71 bytes copied, 6.4672e-05 s, 1.1 MB/s 2024-05-04T07:51:07.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:07.264 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-04T07:51:07.264 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T07:51:07.264 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-04T07:51:07.264 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:51:07.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.448+0000 7fc46d200640 1 Processor -- start 2024-05-04T07:51:07.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.448+0000 7fc46d200640 1 -- start start 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.449+0000 7fc46d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc468166500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.449+0000 7fc46d200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4680cc4f0 con 0x7fc46815b6d0 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.449+0000 7fc46d200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4680cc7c0 con 0x7fc4680cb8e0 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.449+0000 7fc46d200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc46815bab0 con 0x7fc4680c6a50 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc465e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc46815b6d0 0x7fc4680cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:44458/0 (socket says 172.21.15.136:44458) 2024-05-04T07:51:07.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc465e00640 1 -- 172.21.15.136:0/255062864 learned_addr learned my addr 172.21.15.136:0/255062864 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc466800640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc468166500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537749593 0 0) 0x7fc4680cc4f0 con 0x7fc46815b6d0 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c003520 con 0x7fc46815b6d0 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.450+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4224526969 0 0) 0x7fc44c003520 con 0x7fc46815b6d0 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 msgr2=0x7fc468166500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc468166500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 >> v1:172.21.15.142:6789/0 conn(0x7fc4680cb8e0 legacy=0x7fc4680c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc468073480 con 0x7fc46815b6d0 2024-05-04T07:51:07.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fc4580016f0 con 0x7fc46815b6d0 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 >> v1:172.21.15.136:6789/0 conn(0x7fc46815b6d0 legacy=0x7fc4680cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc44c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc44c004800 0x7fc44c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc44c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc46815bab0 con 0x7fc44c003aa0 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c00bbb0 con 0x7fc44c004800 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c00bdb0 con 0x7fc4680c6a50 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465e00640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc44c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc466800640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc44c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc45fe00640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc44c004800 0x7fc44c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465e00640 1 -- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 msgr2=0x7fc44c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465e00640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4680c6a50 0x7fc44c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465e00640 1 -- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc44c004800 msgr2=0x7fc44c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.451+0000 7fc465e00640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc44c004800 0x7fc44c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.452+0000 7fc465e00640 1 -- 172.21.15.136:0/255062864 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c003520 con 0x7fc44c003aa0 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.453+0000 7fc465e00640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc44c003ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc458007d30 tx=0x7fc44c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e278450d023092e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.453+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458007d70 con 0x7fc44c003aa0 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.453+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc458036070 con 0x7fc44c003aa0 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.453+0000 7fc465400640 1 -- 172.21.15.136:0/255062864 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458005d10 con 0x7fc44c003aa0 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 -- 172.21.15.136:0/255062864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 msgr2=0x7fc44c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 --2- 172.21.15.136:0/255062864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc44c003ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc458007d30 tx=0x7fc44c005830 comp rx=0 tx=0).stop 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc466800640 1 -- 172.21.15.136:0/255062864 reap_dead start 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 -- 172.21.15.136:0/255062864 shutdown_connections 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 -- 172.21.15.136:0/255062864 >> 172.21.15.136:0/255062864 conn(0x7fc4680d0c30 msgr2=0x7fc4680d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 -- 172.21.15.136:0/255062864 shutdown_connections 2024-05-04T07:51:07.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.454+0000 7fc46d200640 1 -- 172.21.15.136:0/255062864 wait complete. 2024-05-04T07:51:07.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.456+0000 7fc46d200640 1 Processor -- start 2024-05-04T07:51:07.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.456+0000 7fc46d200640 1 -- start start 2024-05-04T07:51:07.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4681f9950 0x7fc4681e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4681e52d0 0x7fc4680c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc468073150 con 0x7fc44c003aa0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc468073a40 con 0x7fc4681f9950 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc46d200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc468073f60 con 0x7fc4681e52d0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.457+0000 7fc465e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60814/0 (socket says 172.21.15.136:60814) 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 -- 172.21.15.136:0/1341770755 learned_addr learned my addr 172.21.15.136:0/1341770755 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc466800640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4681e52d0 0x7fc4680c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc45fe00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4681f9950 0x7fc4681e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 -- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4681e52d0 msgr2=0x7fc4680c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4681e52d0 0x7fc4680c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 -- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4681f9950 msgr2=0x7fc4681e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4681f9950 0x7fc4681e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 -- 172.21.15.136:0/1341770755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4681e5770 con 0x7fc44c003aa0 2024-05-04T07:51:07.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.458+0000 7fc465e00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc45802cfc0 tx=0x7fc468073650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:07.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.459+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458007d70 con 0x7fc44c003aa0 2024-05-04T07:51:07.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.459+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc458040070 con 0x7fc44c003aa0 2024-05-04T07:51:07.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.459+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458001cb0 con 0x7fc44c003aa0 2024-05-04T07:51:07.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.459+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4681f8e70 con 0x7fc44c003aa0 2024-05-04T07:51:07.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.459+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4680b03d0 con 0x7fc44c003aa0 2024-05-04T07:51:07.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.460+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc468069400 con 0x7fc44c003aa0 2024-05-04T07:51:07.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.461+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc458030070 con 0x7fc44c003aa0 2024-05-04T07:51:07.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.462+0000 7fc45e000640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 0x7fc444078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:07.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.462+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc4580b8220 con 0x7fc44c003aa0 2024-05-04T07:51:07.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.462+0000 7fc45fe00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 0x7fc444078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:07.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.463+0000 7fc45fe00640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 0x7fc444078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc468153a60 tx=0x7fc450009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:07.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.467+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc45802e040 con 0x7fc44c003aa0 2024-05-04T07:51:07.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.718+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4680c9640 con 0x7fc44c003aa0 2024-05-04T07:51:07.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.718+0000 7fc45e000640 1 -- 172.21.15.136:0/1341770755 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc4580818b0 con 0x7fc44c003aa0 2024-05-04T07:51:07.720 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-04T07:51:07.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 msgr2=0x7fc444078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 0x7fc444078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc468153a60 tx=0x7fc450009040 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 msgr2=0x7fc4680afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc45802cfc0 tx=0x7fc468073650 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 shutdown_connections 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc4440762d0 0x7fc444078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4681e52d0 0x7fc4680c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4681f9950 0x7fc4681e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 --2- 172.21.15.136:0/1341770755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc44c003aa0 0x7fc4680afe90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 >> 172.21.15.136:0/1341770755 conn(0x7fc4680d0c30 msgr2=0x7fc4680ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 shutdown_connections 2024-05-04T07:51:07.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:07.721+0000 7fc46d200640 1 -- 172.21.15.136:0/1341770755 wait complete. 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:51:07.739 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-04T07:51:07.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:07.740 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-05-04T07:51:07.805 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:07.805 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:07.806 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:51:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:51:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42596sec preferred_lft 42596sec 2024-05-04T07:51:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-05-04T07:51:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:07.807 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-04T07:51:07.807 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:07.807 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:07.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-05-04T07:51:07.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-05-04T07:51:07.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-05-04T07:51:07.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-04T07:51:07.808 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:07.898 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:08.254 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:08.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:08.267 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:51:08.338 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-05-04T07:51:08.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:08.343 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-05-04T07:51:08.405 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-05-04T07:51:08.405 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:51:08.405 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:51:08.405 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:51:08.405 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:51:08.406 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:08.407 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:08.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:51:08.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:51:08.407 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:51:08.407 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:08.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:09.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:09.138 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:51:09.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:09.193 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-05-04T07:51:09.246 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:09.246 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:09.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-04T07:51:09.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-04T07:51:09.247 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:09.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:09.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:09.433 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-04T07:51:09.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-04T07:51:09.434 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:09.533 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:09.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:09.725 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:09.725 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:09.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-05-04T07:51:09.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-05-04T07:51:09.726 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:09.819 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:09.912 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:09.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:09.921 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-04T07:51:09.968 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-04T07:51:09.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:09.968 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-04T07:51:10.062 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-04T07:51:10.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:10.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:10.189 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:10.189 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:10.903 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:10.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:10.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-05-04T07:51:10.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 1@9ecc10c5-f8dd-4dd0-88f7-548a507c724d.cephfs=/ 2024-05-04T07:51:10.904 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.136:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-05-04T07:51:10.907 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-04T07:51:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-05-04T07:51:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-04T07:51:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-05-04T07:51:10.907 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-04T07:51:10.912 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-04T07:51:10.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:10.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-04T07:51:10.996 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:11.098 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:11.104 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:11.113 INFO:teuthology.orchestra.run.smithi142.stdout:client4460 2024-05-04T07:51:11.114 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:11.114 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:11.166 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:11.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:11.278 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:11.288 INFO:teuthology.orchestra.run.smithi142.stdout:client4460 2024-05-04T07:51:11.288 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:11.392 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:11.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:11.406 INFO:teuthology.orchestra.run.smithi142.stdout:client4460 2024-05-04T07:51:11.406 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9ecc10c5-f8dd-4dd0-88f7-548a507c724d.client4460/status') 2024-05-04T07:51:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:11.540 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4460 (3)192.168.0.1:0/2123646354 2024-05-04T07:51:11.540 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-05-04T07:51:11.541 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-05-04T07:51:11.541 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-05-04T07:51:11.541 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 8.2518e-05 s, 836 kB/s 2024-05-04T07:51:11.543 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:11.553 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-04T07:51:11.553 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T07:51:11.553 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-04T07:51:11.553 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:51:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.758+0000 7f1717000640 1 Processor -- start 2024-05-04T07:51:11.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.758+0000 7f1717000640 1 -- start start 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.759+0000 7f1717000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f171015f6c0 0x7f17100cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.759+0000 7f1717000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17100afbc0 0x7f17100cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.759+0000 7f1717000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17100ceb20 con 0x7f17100cc6e0 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.759+0000 7f1717000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f171015faa0 con 0x7f171015f6c0 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.759+0000 7f1717000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17100ce8d0 con 0x7f17100afbc0 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f171015f6c0 0x7f17100cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f171015f6c0 0x7f17100cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60818/0 (socket says 172.21.15.136:60818) 2024-05-04T07:51:11.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 -- 172.21.15.136:0/3858802416 learned_addr learned my addr 172.21.15.136:0/3858802416 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:11.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 -- 172.21.15.136:0/3858802416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17100afbc0 msgr2=0x7f17100cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:11.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 --2- 172.21.15.136:0/3858802416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17100afbc0 0x7f17100cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:11.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 -- 172.21.15.136:0/3858802416 >> v1:172.21.15.142:6789/0 conn(0x7f17100cc6e0 legacy=0x7f1710072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:11.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.760+0000 7f1715c00640 1 -- 172.21.15.136:0/3858802416 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100cee00 con 0x7f171015f6c0 2024-05-04T07:51:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.761+0000 7f1715c00640 1 --2- 172.21.15.136:0/3858802416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f171015f6c0 0x7f17100cb020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1704009870 tx=0x7f170402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6a06120dc24b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.761+0000 7f170fe00640 1 -- 172.21.15.136:0/3858802416 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704037070 con 0x7f171015f6c0 2024-05-04T07:51:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f170fe00640 1 -- 172.21.15.136:0/3858802416 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1704032440 con 0x7f171015f6c0 2024-05-04T07:51:11.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f170fe00640 1 -- 172.21.15.136:0/3858802416 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704032810 con 0x7f171015f6c0 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 -- 172.21.15.136:0/3858802416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f171015f6c0 msgr2=0x7f17100cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 --2- 172.21.15.136:0/3858802416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f171015f6c0 0x7f17100cb020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1704009870 tx=0x7f170402a130 comp rx=0 tx=0).stop 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 -- 172.21.15.136:0/3858802416 shutdown_connections 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 --2- 172.21.15.136:0/3858802416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17100afbc0 0x7f17100cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 --2- 172.21.15.136:0/3858802416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f171015f6c0 0x7f17100cb020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 -- 172.21.15.136:0/3858802416 >> 172.21.15.136:0/3858802416 conn(0x7f17100d09d0 msgr2=0x7f17100d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:11.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.762+0000 7f1717000640 1 -- 172.21.15.136:0/3858802416 shutdown_connections 2024-05-04T07:51:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.763+0000 7f1717000640 1 -- 172.21.15.136:0/3858802416 wait complete. 2024-05-04T07:51:11.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.764+0000 7f1717000640 1 Processor -- start 2024-05-04T07:51:11.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.764+0000 7f1717000640 1 -- start start 2024-05-04T07:51:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100cc6e0 0x7f17100c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f171015f6c0 0x7f17100ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f17100cace0 con 0x7f17100afbc0 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1710073d70 con 0x7f17100cc6e0 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1717000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17100cae60 con 0x7f171015f6c0 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.765+0000 7f1715c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60820/0 (socket says 172.21.15.136:60820) 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 -- 172.21.15.136:0/1933198327 learned_addr learned my addr 172.21.15.136:0/1933198327 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 -- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f171015f6c0 msgr2=0x7f17100ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f171015f6c0 0x7f17100ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 -- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100cc6e0 msgr2=0x7f17100c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100cc6e0 0x7f17100c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:11.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 -- 172.21.15.136:0/1933198327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100c7cb0 con 0x7f17100afbc0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.766+0000 7f1715c00640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1704009870 tx=0x7f17040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.767+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704041070 con 0x7f17100afbc0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.767+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170403c870 con 0x7f17100afbc0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.767+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17100c7f90 con 0x7f17100afbc0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.767+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704037040 con 0x7f17100afbc0 2024-05-04T07:51:11.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.767+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17100c8550 con 0x7f17100afbc0 2024-05-04T07:51:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.768+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17100c8880 con 0x7f17100afbc0 2024-05-04T07:51:11.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.769+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1704044070 con 0x7f17100afbc0 2024-05-04T07:51:11.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.770+0000 7f170d600640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 0x7f16f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.770+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f17040b8610 con 0x7f17100afbc0 2024-05-04T07:51:11.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.770+0000 7f1715200640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 0x7f16f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:11.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.771+0000 7f1715200640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 0x7f16f0078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f17101498f0 tx=0x7f16fc0079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:11.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:11.775+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1704081ab0 con 0x7f17100afbc0 2024-05-04T07:51:12.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.024+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17100cb020 con 0x7f17100afbc0 2024-05-04T07:51:12.026 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.024+0000 7f170d600640 1 -- 172.21.15.136:0/1933198327 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f17100cb020 con 0x7f17100afbc0 2024-05-04T07:51:12.026 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 msgr2=0x7f16f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 0x7f16f0078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f17101498f0 tx=0x7f16fc0079b0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 msgr2=0x7f17101493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1704009870 tx=0x7f17040046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 shutdown_connections 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f16f00762d0 0x7f16f0078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f171015f6c0 0x7f17100ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17100cc6e0 0x7f17100c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 --2- 172.21.15.136:0/1933198327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17100afbc0 0x7f17101493b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 >> 172.21.15.136:0/1933198327 conn(0x7f17100d09d0 msgr2=0x7f17100b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:12.029 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 shutdown_connections 2024-05-04T07:51:12.030 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:12.028+0000 7f1717000640 1 -- 172.21.15.136:0/1933198327 wait complete. 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:51:12.049 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-04T07:51:12.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.050 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-05-04T07:51:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 4a:7f:33:4c:d8:e6 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::2c33:4ff:fe66:6a77/64 scope link 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 4a:7f:33:4c:d8:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::487f:33ff:fe4c:d8e6/64 scope link 2024-05-04T07:51:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.112 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:51:12.192 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-05-04T07:51:12.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.196 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-05-04T07:51:12.246 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-05-04T07:51:12.246 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:51:12.246 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:51:12.246 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:51:12.246 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:51:12.247 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:12.247 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:12.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:51:12.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:51:12.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:51:12.248 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:12.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:12.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.454 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:51:12.500 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-04T07:51:12.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.501 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-05-04T07:51:12.595 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-04T07:51:12.596 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:12.596 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:12.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-04T07:51:12.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-04T07:51:12.596 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:12.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:12.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-04T07:51:12.847 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether da:82:b1:da:4c:3c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d882:b1ff:feda:4c3c/64 scope link 2024-05-04T07:51:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:12.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:12.922 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether da:82:b1:da:4c:3c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-04T07:51:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-04T07:51:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::d882:b1ff:feda:4c3c/64 scope link 2024-05-04T07:51:12.923 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:12.926 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-04T07:51:12.926 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:13.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:13.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:13.202 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:13.202 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-05-04T07:51:13.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2024-05-04T07:51:13.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2024-05-04T07:51:13.202 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-05-04T07:51:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:13.388 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:13.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:13.397 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-04T07:51:13.445 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-04T07:51:13.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:13.445 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-04T07:51:13.497 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-04T07:51:13.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:13.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:13.626 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:13.626 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:13.660 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:13.661 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:13.661 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-05-04T07:51:13.661 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 3@9ecc10c5-f8dd-4dd0-88f7-548a507c724d.cephfs=/ 2024-05-04T07:51:13.661 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.136:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-05-04T07:51:13.663 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-04T07:51:13.663 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-05-04T07:51:13.663 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-04T07:51:13.663 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-05-04T07:51:13.663 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-04T07:51:13.667 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-04T07:51:13.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:13.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-04T07:51:13.738 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:13.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:13.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:13.855 INFO:teuthology.orchestra.run.smithi142.stdout:client4463 2024-05-04T07:51:13.856 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:13.856 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:13.903 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:14.047 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:14.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:14.061 INFO:teuthology.orchestra.run.smithi142.stdout:client4463 2024-05-04T07:51:14.062 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:14.127 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:51:14.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:51:14.168 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:14.172 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:14.181 INFO:teuthology.orchestra.run.smithi142.stdout:client4463 2024-05-04T07:51:14.181 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9ecc10c5-f8dd-4dd0-88f7-548a507c724d.client4463/status') 2024-05-04T07:51:14.324 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:14.354 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4463 (3)192.168.0.2:0/260446999 2024-05-04T07:51:14.354 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-05-04T07:51:14.354 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-05-04T07:51:14.354 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-05-04T07:51:14.354 INFO:teuthology.orchestra.run.smithi142.stderr:68 bytes copied, 0.000102444 s, 664 kB/s 2024-05-04T07:51:14.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-05-04T07:51:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:14.367 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-04T07:51:14.412 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-05-04T07:51:14.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:14.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.627+0000 7f7348a00640 1 Processor -- start 2024-05-04T07:51:14.628 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.627+0000 7f7348a00640 1 -- start start 2024-05-04T07:51:14.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7348a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f734415f510 0x7f73440ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7348a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440d1690 con 0x7f734406dce0 2024-05-04T07:51:14.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7348a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440cbd80 con 0x7f73440cc9c0 2024-05-04T07:51:14.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7348a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f73440d1970 con 0x7f734415f510 2024-05-04T07:51:14.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7342800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f734406dce0 0x7f734406e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41704/0 (socket says 172.21.15.136:41704) 2024-05-04T07:51:14.630 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7342800640 1 -- 172.21.15.136:0/513755311 learned_addr learned my addr 172.21.15.136:0/513755311 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:14.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.629+0000 7f7339e00640 1 --2- 172.21.15.136:0/513755311 >> v2:172.21.15.142:3300/0 conn(0x7f734415f510 0x7f73440ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876413356 0 0) 0x7f73440d1690 con 0x7f734406dce0 2024-05-04T07:51:14.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7328003520 con 0x7f734406dce0 2024-05-04T07:51:14.632 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 660652620 0 0) 0x7f7328003520 con 0x7f734406dce0 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 >> v2:172.21.15.142:3300/0 conn(0x7f734415f510 msgr2=0x7f73440ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 --2- 172.21.15.136:0/513755311 >> v2:172.21.15.142:3300/0 conn(0x7f734415f510 0x7f73440ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 >> v1:172.21.15.142:6789/0 conn(0x7f73440cc9c0 legacy=0x7f73440ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440cc060 con 0x7f734406dce0 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f73340016f0 con 0x7f734406dce0 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 >> v1:172.21.15.136:6789/0 conn(0x7f734406dce0 legacy=0x7f734406e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 0x7f7328003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328004800 0x7f7328004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7328005210 0x7f732800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f732800c120 con 0x7f7328003aa0 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f732800c2d0 con 0x7f7328005210 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.630+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f732800c4d0 con 0x7f7328004800 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 0x7f7328003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7343200640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7328005210 0x7f732800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7339e00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328004800 0x7f7328004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 -- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328004800 msgr2=0x7f7328004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328004800 0x7f7328004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 -- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7328005210 msgr2=0x7f732800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7328005210 0x7f732800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7342800640 1 -- 172.21.15.136:0/513755311 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7328003520 con 0x7f7328003aa0 2024-05-04T07:51:14.634 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.631+0000 7f7343200640 1 -- 172.21.15.136:0/513755311 reap_dead start 2024-05-04T07:51:14.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.632+0000 7f7342800640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 0x7f7328003ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f733400c160 tx=0x7f7328005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241334b741878a33 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:14.635 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334007cc0 con 0x7f7328003aa0 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7334005ad0 con 0x7f7328003aa0 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7341e00640 1 -- 172.21.15.136:0/513755311 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334007070 con 0x7f7328003aa0 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7348a00640 1 -- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 msgr2=0x7f7328003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7348a00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 0x7f7328003ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f733400c160 tx=0x7f7328005830 comp rx=0 tx=0).stop 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7348a00640 1 -- 172.21.15.136:0/513755311 shutdown_connections 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7348a00640 1 --2- 172.21.15.136:0/513755311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7328003aa0 0x7f7328003ec0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.633+0000 7f7348a00640 1 -- 172.21.15.136:0/513755311 >> 172.21.15.136:0/513755311 conn(0x7f73440d09d0 msgr2=0x7f73440d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.634+0000 7f7348a00640 1 -- 172.21.15.136:0/513755311 shutdown_connections 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.634+0000 7f7348a00640 1 -- 172.21.15.136:0/513755311 wait complete. 2024-05-04T07:51:14.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.635+0000 7f7348a00640 1 Processor -- start 2024-05-04T07:51:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 -- start start 2024-05-04T07:51:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328003aa0 0x7f734414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73440b3750 0x7f73440c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f73440cd090 con 0x7f734415ccc0 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f73440ccf10 con 0x7f73440b3750 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.636+0000 7f7348a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f73440cd210 con 0x7f7328003aa0 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54392/0 (socket says 172.21.15.136:54392) 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 -- 172.21.15.136:0/66031974 learned_addr learned my addr 172.21.15.136:0/66031974 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7339e00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73440b3750 0x7f73440c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7342800640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328003aa0 0x7f734414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 -- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328003aa0 msgr2=0x7f734414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328003aa0 0x7f734414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 -- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73440b3750 msgr2=0x7f73440c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73440b3750 0x7f73440c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.637+0000 7f7343200640 1 -- 172.21.15.136:0/66031974 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73440c7290 con 0x7f734415ccc0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f7343200640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73440b0390 tx=0x7f733c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c006b50 con 0x7f734415ccc0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c006d10 con 0x7f734415ccc0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c003970 con 0x7f734415ccc0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73440c61f0 con 0x7f734415ccc0 2024-05-04T07:51:14.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.638+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73440c67b0 con 0x7f734415ccc0 2024-05-04T07:51:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.639+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7344069400 con 0x7f734415ccc0 2024-05-04T07:51:14.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.641+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f733c01a020 con 0x7f734415ccc0 2024-05-04T07:51:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.642+0000 7f733b400640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 0x7f7320078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.642+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f733c0970f0 con 0x7f734415ccc0 2024-05-04T07:51:14.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.642+0000 7f7342800640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 0x7f7320078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:14.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.643+0000 7f7342800640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 0x7f7320078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7334032000 tx=0x7f7334009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:14.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.648+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f733c060590 con 0x7f734415ccc0 2024-05-04T07:51:14.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.857+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73440af830 con 0x7f734415ccc0 2024-05-04T07:51:14.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.860+0000 7f733b400640 1 -- 172.21.15.136:0/66031974 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+19010 (secure 0 0 0) 0x7f733c05fe90 con 0x7f734415ccc0 2024-05-04T07:51:14.861 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:14.861 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:08.784580+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.862+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 msgr2=0x7f7320078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 0x7f7320078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7334032000 tx=0x7f7334009030 comp rx=0 tx=0).stop 2024-05-04T07:51:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 msgr2=0x7f734415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:14.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73440b0390 tx=0x7f733c00eb90 comp rx=0 tx=0).stop 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 shutdown_connections 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f73200762d0 0x7f7320078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f734415ccc0 0x7f734415d150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73440b3750 0x7f73440c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 --2- 172.21.15.136:0/66031974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7328003aa0 0x7f734414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 >> 172.21.15.136:0/66031974 conn(0x7f73440d09d0 msgr2=0x7f73440cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 shutdown_connections 2024-05-04T07:51:14.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:14.863+0000 7f7348a00640 1 -- 172.21.15.136:0/66031974 wait complete. 2024-05-04T07:51:14.884 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-04T07:50:15.303015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-04T07:50:25.081524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-04T07:50:25.933776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-04T07:50:29.536357+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-04T07:51:14.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-04T07:51:15.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.087+0000 7f96c2800640 1 Processor -- start 2024-05-04T07:51:15.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.088+0000 7f96c2800640 1 -- start start 2024-05-04T07:51:15.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.089+0000 7f96c2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fae0 0x7f96bc0cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.089+0000 7f96c2800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96bc15fec0 0x7f96bc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.089+0000 7f96c2800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc0d06e0 con 0x7f96bc06de30 2024-05-04T07:51:15.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.089+0000 7f96c2800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc0cea70 con 0x7f96bc15fec0 2024-05-04T07:51:15.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.089+0000 7f96c2800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc0ced50 con 0x7f96bc15fae0 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.090+0000 7f96c0a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96bc15fec0 0x7f96bc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.090+0000 7f96c0a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f96bc15fec0 0x7f96bc0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:55456/0 (socket says 172.21.15.136:55456) 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.090+0000 7f96c0a00640 1 -- 172.21.15.136:0/2283031490 learned_addr learned my addr 172.21.15.136:0/2283031490 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.090+0000 7f96c1400640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fae0 0x7f96bc0cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.091+0000 7f96c0a00640 1 -- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fae0 msgr2=0x7f96bc0cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:15.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.091+0000 7f96c0a00640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fae0 0x7f96bc0cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.091+0000 7f96c0a00640 1 -- 172.21.15.136:0/2283031490 >> v1:172.21.15.142:6789/0 conn(0x7f96bc06de30 legacy=0x7f96bc0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.091+0000 7f96c0a00640 1 -- 172.21.15.136:0/2283031490 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc0cf030 con 0x7f96bc15fec0 2024-05-04T07:51:15.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.092+0000 7f96c0a00640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fec0 0x7f96bc0cf550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a802a2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3141159a8ee72f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96bbe00640 1 -- 172.21.15.136:0/2283031490 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8037070 con 0x7f96bc15fec0 2024-05-04T07:51:15.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96bbe00640 1 -- 172.21.15.136:0/2283031490 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8032640 con 0x7f96bc15fec0 2024-05-04T07:51:15.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96bbe00640 1 -- 172.21.15.136:0/2283031490 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8032a10 con 0x7f96bc15fec0 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96c2800640 1 -- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fec0 msgr2=0x7f96bc0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96c2800640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fec0 0x7f96bc0cf550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a802a2f0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96c2800640 1 -- 172.21.15.136:0/2283031490 shutdown_connections 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.093+0000 7f96c2800640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fec0 0x7f96bc0cf550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.094+0000 7f96c2800640 1 --2- 172.21.15.136:0/2283031490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fae0 0x7f96bc0cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.094+0000 7f96c2800640 1 -- 172.21.15.136:0/2283031490 >> 172.21.15.136:0/2283031490 conn(0x7f96bc0cd490 msgr2=0x7f96bc0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.094+0000 7f96c2800640 1 -- 172.21.15.136:0/2283031490 shutdown_connections 2024-05-04T07:51:15.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.094+0000 7f96c2800640 1 -- 172.21.15.136:0/2283031490 wait complete. 2024-05-04T07:51:15.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.096+0000 7f96c2800640 1 Processor -- start 2024-05-04T07:51:15.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.096+0000 7f96c2800640 1 -- start start 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fae0 0x7f96bc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 0x7f96bc1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0ce810 con 0x7f96bc06de30 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0ce690 con 0x7f96bc15fae0 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c2800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc160340 con 0x7f96bc15fec0 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c1400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c1400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54394/0 (socket says 172.21.15.136:54394) 2024-05-04T07:51:15.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.097+0000 7f96c1400640 1 -- 172.21.15.136:0/2156894511 learned_addr learned my addr 172.21.15.136:0/2156894511 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1e00640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 0x7f96bc1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c0a00640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fae0 0x7f96bc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 -- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 msgr2=0x7f96bc1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 0x7f96bc1f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 -- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fae0 msgr2=0x7f96bc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fae0 0x7f96bc15d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 -- 172.21.15.136:0/2156894511 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc1f6090 con 0x7f96bc06de30 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1e00640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 0x7f96bc1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.098+0000 7f96c1400640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96b000e870 tx=0x7f96b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.099+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0017070 con 0x7f96bc06de30 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.099+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b000c940 con 0x7f96bc06de30 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.099+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b000cd30 con 0x7f96bc06de30 2024-05-04T07:51:15.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.099+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc1f6370 con 0x7f96bc06de30 2024-05-04T07:51:15.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.099+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc1f6650 con 0x7f96bc06de30 2024-05-04T07:51:15.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.100+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96bc069400 con 0x7f96bc06de30 2024-05-04T07:51:15.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.101+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96b001a070 con 0x7f96bc06de30 2024-05-04T07:51:15.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.102+0000 7f96b9600640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 0x7f969c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.102+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f96b0097d10 con 0x7f96bc06de30 2024-05-04T07:51:15.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.103+0000 7f96c0a00640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 0x7f969c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.103 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.103+0000 7f96c0a00640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 0x7f969c078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f96a8034000 tx=0x7f96a802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.107 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.107+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f96b009d020 con 0x7f96bc06de30 2024-05-04T07:51:15.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.313+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96bc0ce330 con 0x7f96bc06de30 2024-05-04T07:51:15.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.314+0000 7f96b9600640 1 -- 172.21.15.136:0/2156894511 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f96b00611b0 con 0x7f96bc06de30 2024-05-04T07:51:15.315 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 1 2024-05-04T07:51:15.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 msgr2=0x7f969c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 0x7f969c078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f96a8034000 tx=0x7f96a802e000 comp rx=0 tx=0).stop 2024-05-04T07:51:15.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 msgr2=0x7f96bc14e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f96b000e870 tx=0x7f96b000ed30 comp rx=0 tx=0).stop 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 shutdown_connections 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f969c0762d0 0x7f969c078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f96bc15fec0 0x7f96bc1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f96bc15fae0 0x7f96bc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 --2- 172.21.15.136:0/2156894511 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96bc06de30 0x7f96bc14e3e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.317+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 >> 172.21.15.136:0/2156894511 conn(0x7f96bc0cd490 msgr2=0x7f96bc0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.318+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 shutdown_connections 2024-05-04T07:51:15.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.318+0000 7f96c2800640 1 -- 172.21.15.136:0/2156894511 wait complete. 2024-05-04T07:51:15.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-04T07:51:15.546 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.546+0000 7f950d000640 1 Processor -- start 2024-05-04T07:51:15.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.546+0000 7f950d000640 1 -- start start 2024-05-04T07:51:15.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f950d000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95080cb340 0x7f95080c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f950d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080ce5e0 0x7f95080cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f950d000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95080ccfa0 con 0x7f9508145ad0 2024-05-04T07:51:15.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f950d000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9508145eb0 con 0x7f95080cb340 2024-05-04T07:51:15.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f950d000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95080cd280 con 0x7f95080ce5e0 2024-05-04T07:51:15.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f9507400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9508145ad0 0x7f95080c62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41712/0 (socket says 172.21.15.136:41712) 2024-05-04T07:51:15.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f9507400640 1 -- 172.21.15.136:0/1086980101 learned_addr learned my addr 172.21.15.136:0/1086980101 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f9506a00640 1 --2- 172.21.15.136:0/1086980101 >> v2:172.21.15.142:3300/0 conn(0x7f95080cb340 0x7f95080c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.548+0000 7f9507e00640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080ce5e0 0x7f95080cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506000640 1 -- 172.21.15.136:0/1086980101 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543777582 0 0) 0x7f95080ccfa0 con 0x7f9508145ad0 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506000640 1 -- 172.21.15.136:0/1086980101 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94ec003520 con 0x7f9508145ad0 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506a00640 1 -- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080ce5e0 msgr2=0x7f95080cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506a00640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080ce5e0 0x7f95080cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506a00640 1 -- 172.21.15.136:0/1086980101 >> v1:172.21.15.136:6789/0 conn(0x7f9508145ad0 legacy=0x7f95080c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.549+0000 7f9506a00640 1 -- 172.21.15.136:0/1086980101 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080d0460 con 0x7f95080cb340 2024-05-04T07:51:15.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.550+0000 7f9506a00640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080cb340 0x7f95080c69f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9b50d8d545bde1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.551+0000 7f9506000640 1 -- 172.21.15.136:0/1086980101 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8037070 con 0x7f95080cb340 2024-05-04T07:51:15.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.551+0000 7f9506000640 1 -- 172.21.15.136:0/1086980101 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8032440 con 0x7f95080cb340 2024-05-04T07:51:15.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.551+0000 7f9506000640 1 -- 172.21.15.136:0/1086980101 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8032810 con 0x7f95080cb340 2024-05-04T07:51:15.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 -- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080cb340 msgr2=0x7f95080c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080cb340 0x7f95080c69f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802a180 comp rx=0 tx=0).stop 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 -- 172.21.15.136:0/1086980101 shutdown_connections 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080ce5e0 0x7f95080cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 --2- 172.21.15.136:0/1086980101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080cb340 0x7f95080c69f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 -- 172.21.15.136:0/1086980101 >> 172.21.15.136:0/1086980101 conn(0x7f95080cd490 msgr2=0x7f95080cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 -- 172.21.15.136:0/1086980101 shutdown_connections 2024-05-04T07:51:15.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.552+0000 7f950d000640 1 -- 172.21.15.136:0/1086980101 wait complete. 2024-05-04T07:51:15.554 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.554+0000 7f950d000640 1 Processor -- start 2024-05-04T07:51:15.554 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.554+0000 7f950d000640 1 -- start start 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080cb340 0x7f9508137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080ce5e0 0x7f9508137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95080ccbc0 con 0x7f9508145ad0 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95080c6f30 con 0x7f95080ce5e0 2024-05-04T07:51:15.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f950d000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95080ccd40 con 0x7f95080cb340 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f9507e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f9507e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54400/0 (socket says 172.21.15.136:54400) 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.555+0000 7f9507e00640 1 -- 172.21.15.136:0/1889015819 learned_addr learned my addr 172.21.15.136:0/1889015819 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9506a00640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080ce5e0 0x7f9508137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507400640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080cb340 0x7f9508137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 -- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080cb340 msgr2=0x7f9508137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080cb340 0x7f9508137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 -- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080ce5e0 msgr2=0x7f9508137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080ce5e0 0x7f9508137890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 -- 172.21.15.136:0/1889015819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9508139790 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f9507e00640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d20 tx=0x7f950000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500018020 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9500009b10 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9508139a70 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.556+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95000146c0 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.557+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950813a030 con 0x7f9508145ad0 2024-05-04T07:51:15.558 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.558+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080cad50 con 0x7f9508145ad0 2024-05-04T07:51:15.559 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.559+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9500005d10 con 0x7f9508145ad0 2024-05-04T07:51:15.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.560+0000 7f94ff400640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 0x7f94e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:15.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.560+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9500098520 con 0x7f9508145ad0 2024-05-04T07:51:15.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.560+0000 7f9507400640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 0x7f94e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:15.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.561+0000 7f9507400640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 0x7f94e4078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94f0001220 tx=0x7f94f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:15.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.564+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9500022070 con 0x7f9508145ad0 2024-05-04T07:51:15.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.773+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f95080ce2c0 con 0x7f9508145ad0 2024-05-04T07:51:15.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.774+0000 7f94ff400640 1 -- 172.21.15.136:0/1889015819 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f9500010040 con 0x7f9508145ad0 2024-05-04T07:51:15.775 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-05-04T07:51:15.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 msgr2=0x7f94e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 0x7f94e4078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94f0001220 tx=0x7f94f0009040 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 msgr2=0x7f95081f67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d20 tx=0x7f950000c490 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 shutdown_connections 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f94e40762d0 0x7f94e4078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9508145ad0 0x7f95081f67a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95080ce5e0 0x7f9508137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 --2- 172.21.15.136:0/1889015819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95080cb340 0x7f9508137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 >> 172.21.15.136:0/1889015819 conn(0x7f95080cd490 msgr2=0x7f9508072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 shutdown_connections 2024-05-04T07:51:15.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.777+0000 7f950d000640 1 -- 172.21.15.136:0/1889015819 wait complete. 2024-05-04T07:51:15.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-04T07:51:15.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.998+0000 7fee85e00640 1 Processor -- start 2024-05-04T07:51:15.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:15.998+0000 7fee85e00640 1 -- start start 2024-05-04T07:51:16.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee85e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee8006de30 0x7fee8006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.000 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee85e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8006e780 con 0x7fee800cff90 2024-05-04T07:51:16.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee85e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800d0440 con 0x7fee8015fae0 2024-05-04T07:51:16.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee85e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fee800d06e0 con 0x7fee8006de30 2024-05-04T07:51:16.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee7fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fee800cff90 0x7fee800cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41728/0 (socket says 172.21.15.136:41728) 2024-05-04T07:51:16.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee7fe00640 1 -- 172.21.15.136:0/3927951423 learned_addr learned my addr 172.21.15.136:0/3927951423 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:16.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.000+0000 7fee85400640 1 --2- 172.21.15.136:0/3927951423 >> v2:172.21.15.142:3300/0 conn(0x7fee8006de30 0x7fee8006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745434549 0 0) 0x7fee6c001110 con 0x7fee800cff90 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003520 con 0x7fee800cff90 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4185171001 0 0) 0x7fee68003520 con 0x7fee800cff90 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 >> v2:172.21.15.142:3300/0 conn(0x7fee8006de30 msgr2=0x7fee8006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 --2- 172.21.15.136:0/3927951423 >> v2:172.21.15.142:3300/0 conn(0x7fee8006de30 0x7fee8006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 >> v1:172.21.15.142:6789/0 conn(0x7fee8015fae0 legacy=0x7fee8015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800cea70 con 0x7fee800cff90 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fee6c0018c0 con 0x7fee800cff90 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 >> v1:172.21.15.136:6789/0 conn(0x7fee800cff90 legacy=0x7fee800cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 0x7fee68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee800d06e0 con 0x7fee68003a50 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fee6800c140 con 0x7fee680051c0 2024-05-04T07:51:16.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fee6800c340 con 0x7fee68004800 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.001+0000 7fee84a00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 0x7fee68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee85400640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee84a00640 1 -- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee68004800 msgr2=0x7fee68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee84a00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee84a00640 1 -- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee680051c0 msgr2=0x7fee6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee84a00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee680051c0 0x7fee6800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee85400640 1 -- 172.21.15.136:0/3927951423 reap_dead start 2024-05-04T07:51:16.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.002+0000 7fee84a00640 1 -- 172.21.15.136:0/3927951423 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68003520 con 0x7fee68003a50 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.003+0000 7fee84a00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 0x7fee68003e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fee74001790 tx=0x7fee68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef5fbd492f98e74 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.003+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740013b0 con 0x7fee68003a50 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.003+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740052d0 con 0x7fee68003a50 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.003+0000 7fee7f400640 1 -- 172.21.15.136:0/3927951423 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7402aa80 con 0x7fee68003a50 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 -- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 msgr2=0x7fee68003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 0x7fee68003e70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fee74001790 tx=0x7fee68005830 comp rx=0 tx=0).stop 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 -- 172.21.15.136:0/3927951423 shutdown_connections 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 --2- 172.21.15.136:0/3927951423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee68003a50 0x7fee68003e70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 -- 172.21.15.136:0/3927951423 >> 172.21.15.136:0/3927951423 conn(0x7fee800cd490 msgr2=0x7fee800cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:16.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 -- 172.21.15.136:0/3927951423 shutdown_connections 2024-05-04T07:51:16.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.004+0000 7fee85e00640 1 -- 172.21.15.136:0/3927951423 wait complete. 2024-05-04T07:51:16.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.006+0000 7fee85e00640 1 Processor -- start 2024-05-04T07:51:16.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.006+0000 7fee85e00640 1 -- start start 2024-05-04T07:51:16.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee68003a50 0x7fee8015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee801480d0 0x7fee80144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee800ce690 con 0x7fee801450d0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fee800cf030 con 0x7fee68003a50 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fee800ce810 con 0x7fee801480d0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54418/0 (socket says 172.21.15.136:54418) 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 -- 172.21.15.136:0/495415254 learned_addr learned my addr 172.21.15.136:0/495415254 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee84a00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee68003a50 0x7fee8015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee7fe00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee801480d0 0x7fee80144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 -- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee801480d0 msgr2=0x7fee80144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee801480d0 0x7fee80144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 -- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee68003a50 msgr2=0x7fee8015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee68003a50 0x7fee8015ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.007+0000 7fee85400640 1 -- 172.21.15.136:0/495415254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80159aa0 con 0x7fee801450d0 2024-05-04T07:51:16.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee85400640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee800d09c0 tx=0x7fee7800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78016420 con 0x7fee801450d0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7801b070 con 0x7fee801450d0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78016820 con 0x7fee801450d0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee80159d80 con 0x7fee801450d0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.008+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8015a340 con 0x7fee801450d0 2024-05-04T07:51:16.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.009+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee80069400 con 0x7fee801450d0 2024-05-04T07:51:16.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.010+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fee780169c0 con 0x7fee801450d0 2024-05-04T07:51:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.012+0000 7fee7cc00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 0x7fee600787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.012+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fee78098750 con 0x7fee801450d0 2024-05-04T07:51:16.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.012+0000 7fee84a00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 0x7fee600787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.013+0000 7fee84a00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 0x7fee600787c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee74032000 tx=0x7fee7402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.016+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fee78061c80 con 0x7fee801450d0 2024-05-04T07:51:16.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.221+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fee8015b080 con 0x7fee801450d0 2024-05-04T07:51:16.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.223+0000 7fee7cc00640 1 -- 172.21.15.136:0/495415254 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fee78061580 con 0x7fee801450d0 2024-05-04T07:51:16.223 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 64 2024-05-04T07:51:16.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 msgr2=0x7fee600787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 0x7fee600787c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fee74032000 tx=0x7fee7402e000 comp rx=0 tx=0).stop 2024-05-04T07:51:16.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 msgr2=0x7fee800b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee800d09c0 tx=0x7fee7800f520 comp rx=0 tx=0).stop 2024-05-04T07:51:16.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 shutdown_connections 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee60076300 0x7fee600787c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee801450d0 0x7fee800b3750 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee801480d0 0x7fee80144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 --2- 172.21.15.136:0/495415254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee68003a50 0x7fee8015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 >> 172.21.15.136:0/495415254 conn(0x7fee800cd490 msgr2=0x7fee800c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 shutdown_connections 2024-05-04T07:51:16.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.225+0000 7fee85e00640 1 -- 172.21.15.136:0/495415254 wait complete. 2024-05-04T07:51:16.245 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-04T07:51:16.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.448+0000 7fde8ac00640 1 Processor -- start 2024-05-04T07:51:16.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.448+0000 7fde8ac00640 1 -- start start 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde8406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde84073d50 0x7fde840723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fde84072920 0x7fde840cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fde8415df70 con 0x7fde84073d50 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fde8406ff90 con 0x7fde84072920 2024-05-04T07:51:16.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.449+0000 7fde8ac00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fde840701e0 con 0x7fde8415ad40 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde84073d50 0x7fde840723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde84073d50 0x7fde840723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54434/0 (socket says 172.21.15.136:54434) 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 -- 172.21.15.136:0/294310192 learned_addr learned my addr 172.21.15.136:0/294310192 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde83e00640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde8406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 -- 172.21.15.136:0/294310192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 msgr2=0x7fde8406fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde88c00640 1 --2- 172.21.15.136:0/294310192 >> v2:172.21.15.142:3300/0 conn(0x7fde84072920 0x7fde840cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde8406fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 -- 172.21.15.136:0/294310192 >> v2:172.21.15.142:3300/0 conn(0x7fde84072920 msgr2=0x7fde840cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 --2- 172.21.15.136:0/294310192 >> v2:172.21.15.142:3300/0 conn(0x7fde84072920 0x7fde840cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde7b400640 1 -- 172.21.15.136:0/294310192 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8415d640 con 0x7fde84073d50 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.450+0000 7fde83e00640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde8406fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.451+0000 7fde7b400640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84073d50 0x7fde840723e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde840c7cb0 tx=0x7fde6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35137dee51142c2f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.452+0000 7fde83400640 1 -- 172.21.15.136:0/294310192 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c037070 con 0x7fde84073d50 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.452+0000 7fde83400640 1 -- 172.21.15.136:0/294310192 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6c032440 con 0x7fde84073d50 2024-05-04T07:51:16.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.452+0000 7fde83400640 1 -- 172.21.15.136:0/294310192 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c032810 con 0x7fde84073d50 2024-05-04T07:51:16.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.452+0000 7fde8ac00640 1 -- 172.21.15.136:0/294310192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84073d50 msgr2=0x7fde840723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.452+0000 7fde8ac00640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84073d50 0x7fde840723e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fde840c7cb0 tx=0x7fde6c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.453 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 -- 172.21.15.136:0/294310192 shutdown_connections 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 --2- 172.21.15.136:0/294310192 >> v2:172.21.15.142:3300/0 conn(0x7fde84072920 0x7fde840cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84073d50 0x7fde840723e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 --2- 172.21.15.136:0/294310192 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde8406fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 -- 172.21.15.136:0/294310192 >> 172.21.15.136:0/294310192 conn(0x7fde840d0c50 msgr2=0x7fde840d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 -- 172.21.15.136:0/294310192 shutdown_connections 2024-05-04T07:51:16.454 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.453+0000 7fde8ac00640 1 -- 172.21.15.136:0/294310192 wait complete. 2024-05-04T07:51:16.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.454+0000 7fde8ac00640 1 Processor -- start 2024-05-04T07:51:16.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.455+0000 7fde8ac00640 1 -- start start 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.455+0000 7fde8ac00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.455+0000 7fde8ac00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde84073d50 0x7fde84152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.455+0000 7fde8ac00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde84152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde8ac00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde840731a0 con 0x7fde84072920 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde8ac00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fde8415dc00 con 0x7fde84073d50 2024-05-04T07:51:16.456 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde8ac00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fde8415e400 con 0x7fde8415ad40 2024-05-04T07:51:16.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54436/0 (socket says 172.21.15.136:54436) 2024-05-04T07:51:16.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 -- 172.21.15.136:0/1397999386 learned_addr learned my addr 172.21.15.136:0/1397999386 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 -- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 msgr2=0x7fde84152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde84152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 -- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde84073d50 msgr2=0x7fde84152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde84073d50 0x7fde84152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.456+0000 7fde83e00640 1 -- 172.21.15.136:0/1397999386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840b4b00 con 0x7fde84072920 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde83e00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c820 tx=0x7fde7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74015070 con 0x7fde84072920 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde74007a30 con 0x7fde84072920 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74007de0 con 0x7fde84072920 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde840b4de0 con 0x7fde84072920 2024-05-04T07:51:16.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.457+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde840b53a0 con 0x7fde84072920 2024-05-04T07:51:16.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.458+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde84069470 con 0x7fde84072920 2024-05-04T07:51:16.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.459+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde74018070 con 0x7fde84072920 2024-05-04T07:51:16.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.461+0000 7fde80c00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 0x7fde60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.461+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fde74097900 con 0x7fde84072920 2024-05-04T07:51:16.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.461+0000 7fde7b400640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 0x7fde60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.462+0000 7fde7b400640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 0x7fde60078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde6c034000 tx=0x7fde6c02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.465+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde74060e30 con 0x7fde84072920 2024-05-04T07:51:16.668 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.667+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fde840d17d0 con 0x7fde84072920 2024-05-04T07:51:16.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.668+0000 7fde80c00640 1 -- 172.21.15.136:0/1397999386 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fde74060730 con 0x7fde84072920 2024-05-04T07:51:16.669 INFO:teuthology.orchestra.run.smithi136.stdout:pg_num: 32 2024-05-04T07:51:16.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 msgr2=0x7fde60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 0x7fde60078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fde6c034000 tx=0x7fde6c02c000 comp rx=0 tx=0).stop 2024-05-04T07:51:16.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 msgr2=0x7fde841546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde7400c820 tx=0x7fde7400cce0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.672 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 shutdown_connections 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fde600762d0 0x7fde60078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde8415ad40 0x7fde84152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde84073d50 0x7fde84152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 --2- 172.21.15.136:0/1397999386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde84072920 0x7fde841546c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 >> 172.21.15.136:0/1397999386 conn(0x7fde840d0c50 msgr2=0x7fde8415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 shutdown_connections 2024-05-04T07:51:16.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.671+0000 7fde8ac00640 1 -- 172.21.15.136:0/1397999386 wait complete. 2024-05-04T07:51:16.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-04T07:51:16.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.881+0000 7fa102c00640 1 Processor -- start 2024-05-04T07:51:16.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.881+0000 7fa102c00640 1 -- start start 2024-05-04T07:51:16.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 0x7fa0fc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0fc0d1690 con 0x7fa0fc15f510 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc0d1970 con 0x7fa0fc06dce0 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa0fc0cbd80 con 0x7fa0fc0cc9c0 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa101800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa101800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54442/0 (socket says 172.21.15.136:54442) 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa101800640 1 -- 172.21.15.136:0/2245149963 learned_addr learned my addr 172.21.15.136:0/2245149963 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:16.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.883+0000 7fa102200640 1 --2- 172.21.15.136:0/2245149963 >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 0x7fa0fc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.884+0000 7fa101800640 1 -- 172.21.15.136:0/2245149963 >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 msgr2=0x7fa0fc0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.884+0000 7fa101800640 1 --2- 172.21.15.136:0/2245149963 >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 0x7fa0fc0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.884+0000 7fa101800640 1 -- 172.21.15.136:0/2245149963 >> v1:172.21.15.142:6789/0 conn(0x7fa0fc15f510 legacy=0x7fa0fc06e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.884+0000 7fa101800640 1 -- 172.21.15.136:0/2245149963 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc0cc060 con 0x7fa0fc06dce0 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.884+0000 7fa102200640 1 --2- 172.21.15.136:0/2245149963 >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 0x7fa0fc0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa101800640 1 --2- 172.21.15.136:0/2245149963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0ce4d0 tx=0x7fa0f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb009b933de8651 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa0fbe00640 1 -- 172.21.15.136:0/2245149963 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0037070 con 0x7fa0fc06dce0 2024-05-04T07:51:16.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa0fbe00640 1 -- 172.21.15.136:0/2245149963 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f0032440 con 0x7fa0fc06dce0 2024-05-04T07:51:16.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa0fbe00640 1 -- 172.21.15.136:0/2245149963 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0032810 con 0x7fa0fc06dce0 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa102c00640 1 -- 172.21.15.136:0/2245149963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 msgr2=0x7fa0fc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.885+0000 7fa102c00640 1 --2- 172.21.15.136:0/2245149963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0ce4d0 tx=0x7fa0f002a270 comp rx=0 tx=0).stop 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 -- 172.21.15.136:0/2245149963 shutdown_connections 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 --2- 172.21.15.136:0/2245149963 >> v2:172.21.15.142:3300/0 conn(0x7fa0fc0cc9c0 0x7fa0fc0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 --2- 172.21.15.136:0/2245149963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ccf10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 -- 172.21.15.136:0/2245149963 >> 172.21.15.136:0/2245149963 conn(0x7fa0fc0d09d0 msgr2=0x7fa0fc0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 -- 172.21.15.136:0/2245149963 shutdown_connections 2024-05-04T07:51:16.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.886+0000 7fa102c00640 1 -- 172.21.15.136:0/2245149963 wait complete. 2024-05-04T07:51:16.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.887+0000 7fa102c00640 1 Processor -- start 2024-05-04T07:51:16.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.887+0000 7fa102c00640 1 -- start start 2024-05-04T07:51:16.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0fc0cc9c0 0x7fa0fc0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0fc15f510 0x7fa0fc15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0aef40 con 0x7fa0fc06dce0 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0aedc0 con 0x7fa0fc0cc9c0 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.888+0000 7fa102c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc0af0c0 con 0x7fa0fc15f510 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54458/0 (socket says 172.21.15.136:54458) 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 -- 172.21.15.136:0/1412123594 learned_addr learned my addr 172.21.15.136:0/1412123594 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 -- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0fc15f510 msgr2=0x7fa0fc15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0fc15f510 0x7fa0fc15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 -- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0fc0cc9c0 msgr2=0x7fa0fc0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0fc0cc9c0 0x7fa0fc0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 -- 172.21.15.136:0/1412123594 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc0c7fe0 con 0x7fa0fc06dce0 2024-05-04T07:51:16.890 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.889+0000 7fa101800640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002a2b0 tx=0x7fa0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.890+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0037040 con 0x7fa0fc06dce0 2024-05-04T07:51:16.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.890+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f0042070 con 0x7fa0fc06dce0 2024-05-04T07:51:16.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.890+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc15c460 con 0x7fa0fc06dce0 2024-05-04T07:51:16.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.890+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0030bb0 con 0x7fa0fc06dce0 2024-05-04T07:51:16.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.890+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc0c8560 con 0x7fa0fc06dce0 2024-05-04T07:51:16.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.891+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0fc069400 con 0x7fa0fc06dce0 2024-05-04T07:51:16.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.892+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa0f0047460 con 0x7fa0fc06dce0 2024-05-04T07:51:16.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.893+0000 7fa0f9600640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 0x7fa0dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:16.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.893+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa0f00b86e0 con 0x7fa0fc06dce0 2024-05-04T07:51:16.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.893+0000 7fa100e00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 0x7fa0dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:16.894 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.894+0000 7fa100e00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 0x7fa0dc078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8006fd0 tx=0x7fa0e8006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:16.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:16.898+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa0f0081b80 con 0x7fa0fc06dce0 2024-05-04T07:51:17.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.179+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7fa0fc06ebc0 con 0x7fa0fc06dce0 2024-05-04T07:51:17.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.842+0000 7fa0f9600640 1 -- 172.21.15.136:0/1412123594 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v68) ==== 123+0+0 (secure 0 0 0) 0x7fa0f0081480 con 0x7fa0fc06dce0 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 msgr2=0x7fa0dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 0x7fa0dc078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8006fd0 tx=0x7fa0e8006bc0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 msgr2=0x7fa0fc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa0f002a2b0 tx=0x7fa0f00046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 shutdown_connections 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa0dc0762d0 0x7fa0dc078790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0fc15f510 0x7fa0fc15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0fc0cc9c0 0x7fa0fc0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 --2- 172.21.15.136:0/1412123594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0fc06dce0 0x7fa0fc0ca730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:17.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 >> 172.21.15.136:0/1412123594 conn(0x7fa0fc0d09d0 msgr2=0x7fa0fc15e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:17.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 shutdown_connections 2024-05-04T07:51:17.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:17.846+0000 7fa102c00640 1 -- 172.21.15.136:0/1412123594 wait complete. 2024-05-04T07:51:17.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-04T07:51:18.073 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.073+0000 7f0f5e600640 1 Processor -- start 2024-05-04T07:51:18.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.073+0000 7f0f5e600640 1 -- start start 2024-05-04T07:51:18.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.074+0000 7f0f5e600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f5806e160 0x7f0f580ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.074+0000 7f0f5e600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f58073090 con 0x7f0f580cec50 2024-05-04T07:51:18.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f5e600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5806f9a0 con 0x7f0f5815bed0 2024-05-04T07:51:18.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f5e600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5806f750 con 0x7f0f5806e160 2024-05-04T07:51:18.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f5dc00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0f580cec50 0x7f0f5815faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41740/0 (socket says 172.21.15.136:41740) 2024-05-04T07:51:18.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3310286780 learned_addr learned my addr 172.21.15.136:0/3310286780 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3310286780 >> v2:172.21.15.142:3300/0 conn(0x7f0f5806e160 0x7f0f580ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166792814 0 0) 0x7f0f58073090 con 0x7f0f580cec50 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.075+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3c003520 con 0x7f0f580cec50 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 73376136 0 0) 0x7f0f3c003520 con 0x7f0f580cec50 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 >> v2:172.21.15.142:3300/0 conn(0x7f0f5806e160 msgr2=0x7f0f580ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 --2- 172.21.15.136:0/3310286780 >> v2:172.21.15.142:3300/0 conn(0x7f0f5806e160 0x7f0f580ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 >> v1:172.21.15.142:6789/0 conn(0x7f0f5815bed0 legacy=0x7f0f58073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:18.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f58160870 con 0x7f0f580cec50 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f0f48001a70 con 0x7f0f580cec50 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 >> v1:172.21.15.136:6789/0 conn(0x7f0f580cec50 legacy=0x7f0f5815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c003a00 0x7f0f3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c005290 0x7f0f3c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5806f750 con 0x7f0f3c004800 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c00e3f0 con 0x7f0f3c003a00 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c00e5f0 con 0x7f0f3c005290 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.076+0000 7f0f5d200640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c003a00 0x7f0f3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f5dc00640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c005290 0x7f0f3c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f57e00640 1 -- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c005290 msgr2=0x7f0f3c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c005290 0x7f0f3c00dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f57e00640 1 -- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c003a00 msgr2=0x7f0f3c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:18.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c003a00 0x7f0f3c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f57e00640 1 -- 172.21.15.136:0/3310286780 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c003520 con 0x7f0f3c004800 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.077+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3310286780 reap_dead start 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000ba30 tx=0x7f0f3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d21611a6070538 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40030070 con 0x7f0f3c004800 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4002ade0 con 0x7f0f3c004800 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f57400640 1 -- 172.21.15.136:0/3310286780 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000b600 con 0x7f0f3c004800 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f5e600640 1 -- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 msgr2=0x7f0f3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.078+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000ba30 tx=0x7f0f3c005830 comp rx=0 tx=0).stop 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.079+0000 7f0f5e600640 1 -- 172.21.15.136:0/3310286780 shutdown_connections 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.079+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3310286780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.079+0000 7f0f5e600640 1 -- 172.21.15.136:0/3310286780 >> 172.21.15.136:0/3310286780 conn(0x7f0f580d0b40 msgr2=0x7f0f580d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.079+0000 7f0f5e600640 1 -- 172.21.15.136:0/3310286780 shutdown_connections 2024-05-04T07:51:18.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.079+0000 7f0f5e600640 1 -- 172.21.15.136:0/3310286780 wait complete. 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.080+0000 7f0f5e600640 1 Processor -- start 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 -- start start 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c004800 0x7f0f5806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f5815e670 0x7f0f5815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5806ddb0 con 0x7f0f5815a000 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5815c2b0 con 0x7f0f5815e670 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.081+0000 7f0f5e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5806df30 con 0x7f0f3c004800 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54476/0 (socket says 172.21.15.136:54476) 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3110948819 learned_addr learned my addr 172.21.15.136:0/3110948819 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f57e00640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f5815e670 0x7f0f5815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5d200640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c004800 0x7f0f5806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.084 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c004800 msgr2=0x7f0f5806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c004800 0x7f0f5806e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f5815e670 msgr2=0x7f0f5815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f5815e670 0x7f0f5815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.082+0000 7f0f5dc00640 1 -- 172.21.15.136:0/3110948819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f580aebd0 con 0x7f0f5815a000 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f5dc00640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f48007c40 tx=0x7f0f4800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48004d60 con 0x7f0f5815a000 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4800bb80 con 0x7f0f5815a000 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f580af450 con 0x7f0f5815a000 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48007070 con 0x7f0f5815a000 2024-05-04T07:51:18.085 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.083+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f580afa10 con 0x7f0f5815a000 2024-05-04T07:51:18.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.084+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f58069400 con 0x7f0f5815a000 2024-05-04T07:51:18.086 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.085+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f4801b020 con 0x7f0f5815a000 2024-05-04T07:51:18.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.086+0000 7f0f54c00640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 0x7f0f340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.087+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0f48097b70 con 0x7f0f5815a000 2024-05-04T07:51:18.087 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.087+0000 7f0f5d200640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 0x7f0f340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.088 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.087+0000 7f0f5d200640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 0x7f0f340787c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.091 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.091+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f48061010 con 0x7f0f5815a000 2024-05-04T07:51:18.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.299+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0f580d17d0 con 0x7f0f5815a000 2024-05-04T07:51:18.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.306+0000 7f0f54c00640 1 -- 172.21.15.136:0/3110948819 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0f48060910 con 0x7f0f5815a000 2024-05-04T07:51:18.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 msgr2=0x7f0f340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 0x7f0f340787c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 msgr2=0x7f0f5815a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f48007c40 tx=0x7f0f4800b4a0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 shutdown_connections 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0f34076300 0x7f0f340787c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f5815a000 0x7f0f5815a460 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f5815e670 0x7f0f5815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 --2- 172.21.15.136:0/3110948819 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c004800 0x7f0f5806e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.309+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 >> 172.21.15.136:0/3110948819 conn(0x7f0f580d0b40 msgr2=0x7f0f58072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:18.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.310+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 shutdown_connections 2024-05-04T07:51:18.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.310+0000 7f0f5e600640 1 -- 172.21.15.136:0/3110948819 wait complete. 2024-05-04T07:51:18.330 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-04T07:51:18.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-04T07:51:18.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-04T07:51:18.544 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-04T07:51:18.544 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:18.545 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:18.603 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:18.603 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:18.656 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:18.656 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:18.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:51:18.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.911+0000 7fc7af000640 1 Processor -- start 2024-05-04T07:51:18.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.911+0000 7fc7af000640 1 -- start start 2024-05-04T07:51:18.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7af000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7af000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 0x7fc7a80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7af000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a80ccfa0 con 0x7fc7a80c6d60 2024-05-04T07:51:18.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7af000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a8145eb0 con 0x7fc7a80cb340 2024-05-04T07:51:18.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7af000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80cd280 con 0x7fc7a8145ad0 2024-05-04T07:51:18.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7adc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7ad200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 0x7fc7a80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7adc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:52742/0 (socket says 172.21.15.136:52742) 2024-05-04T07:51:18.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.913+0000 7fc7adc00640 1 -- 172.21.15.136:0/1255103600 learned_addr learned my addr 172.21.15.136:0/1255103600 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:18.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.914+0000 7fc7adc00640 1 -- 172.21.15.136:0/1255103600 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 msgr2=0x7fc7a80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:18.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.914+0000 7fc7adc00640 1 --2- 172.21.15.136:0/1255103600 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 0x7fc7a80c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.914+0000 7fc7adc00640 1 -- 172.21.15.136:0/1255103600 >> v1:172.21.15.142:6789/0 conn(0x7fc7a80c6d60 legacy=0x7fc7a8160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.914+0000 7fc7adc00640 1 -- 172.21.15.136:0/1255103600 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80d0460 con 0x7fc7a8145ad0 2024-05-04T07:51:18.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.914+0000 7fc7ad200640 1 --2- 172.21.15.136:0/1255103600 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 0x7fc7a80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:51:18.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.916+0000 7fc7adc00640 1 --2- 172.21.15.136:0/1255103600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c781bced117d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.916+0000 7fc7a7e00640 1 -- 172.21.15.136:0/1255103600 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c037070 con 0x7fc7a8145ad0 2024-05-04T07:51:18.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7a7e00640 1 -- 172.21.15.136:0/1255103600 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c032440 con 0x7fc7a8145ad0 2024-05-04T07:51:18.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7a7e00640 1 -- 172.21.15.136:0/1255103600 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c032810 con 0x7fc7a8145ad0 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 -- 172.21.15.136:0/1255103600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 msgr2=0x7fc7a80c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 --2- 172.21.15.136:0/1255103600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009870 tx=0x7fc79c02a270 comp rx=0 tx=0).stop 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 -- 172.21.15.136:0/1255103600 shutdown_connections 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 --2- 172.21.15.136:0/1255103600 >> v2:172.21.15.142:3300/0 conn(0x7fc7a80cb340 0x7fc7a80c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 --2- 172.21.15.136:0/1255103600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a8145ad0 0x7fc7a80c62e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 -- 172.21.15.136:0/1255103600 >> 172.21.15.136:0/1255103600 conn(0x7fc7a80cd490 msgr2=0x7fc7a80cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:18.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 -- 172.21.15.136:0/1255103600 shutdown_connections 2024-05-04T07:51:18.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.917+0000 7fc7af000640 1 -- 172.21.15.136:0/1255103600 wait complete. 2024-05-04T07:51:18.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.919+0000 7fc7af000640 1 Processor -- start 2024-05-04T07:51:18.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.919+0000 7fc7af000640 1 -- start start 2024-05-04T07:51:18.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80c6d60 0x7fc7a813c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80cb340 0x7fc7a813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80ccd40 con 0x7fc7a8145ad0 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80ccbc0 con 0x7fc7a80c6d60 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.920+0000 7fc7af000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80cf5f0 con 0x7fc7a80cb340 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54488/0 (socket says 172.21.15.136:54488) 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 -- 172.21.15.136:0/3535960061 learned_addr learned my addr 172.21.15.136:0/3535960061 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7adc00640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80c6d60 0x7fc7a813c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ad200640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80cb340 0x7fc7a813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 -- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80cb340 msgr2=0x7fc7a813cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80cb340 0x7fc7a813cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 -- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80c6d60 msgr2=0x7fc7a813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:18.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80c6d60 0x7fc7a813c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:18.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 -- 172.21.15.136:0/3535960061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80ca470 con 0x7fc7a8145ad0 2024-05-04T07:51:18.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.921+0000 7fc7ae600640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c730 tx=0x7fc7a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.922+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0003b70 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.922+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a0003d10 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.922+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a80b40a0 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.922+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00052f0 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.922+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a80b4660 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.923+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a8069400 con 0x7fc7a8145ad0 2024-05-04T07:51:18.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.924+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7a00056a0 con 0x7fc7a8145ad0 2024-05-04T07:51:18.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.926+0000 7fc7a5600640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 0x7fc788078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:18.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.926+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc7a0097a50 con 0x7fc7a8145ad0 2024-05-04T07:51:18.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.926+0000 7fc7adc00640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 0x7fc788078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:18.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.927+0000 7fc7adc00640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 0x7fc788078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc79c034000 tx=0x7fc79c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:18.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:18.930+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc7a0060fa0 con 0x7fc7a8145ad0 2024-05-04T07:51:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.153+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7a80c6750 con 0x7fc7a8145ad0 2024-05-04T07:51:19.154 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.154+0000 7fc7a5600640 1 -- 172.21.15.136:0/3535960061 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fc7a00608a0 con 0x7fc7a8145ad0 2024-05-04T07:51:19.155 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 msgr2=0x7fc788078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 0x7fc788078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc79c034000 tx=0x7fc79c02e000 comp rx=0 tx=0).stop 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 msgr2=0x7fc7a813d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc7a000c730 tx=0x7fc7a000cbf0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 shutdown_connections 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc7880762d0 0x7fc788078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc7a8145ad0 0x7fc7a813d270 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc7a80cb340 0x7fc7a813cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 --2- 172.21.15.136:0/3535960061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7a80c6d60 0x7fc7a813c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 >> 172.21.15.136:0/3535960061 conn(0x7fc7a80cd490 msgr2=0x7fc7a80c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 shutdown_connections 2024-05-04T07:51:19.159 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.157+0000 7fc7af000640 1 -- 172.21.15.136:0/3535960061 wait complete. 2024-05-04T07:51:19.176 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-04T07:51:19.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:19.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-04T07:51:19.265 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:51:19.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:19.265 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-04T07:51:19.315 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:19.315 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:19.375 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:19.375 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:19.427 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:19.427 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:19.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:51:19.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.692+0000 7febece00640 1 Processor -- start 2024-05-04T07:51:19.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.693+0000 7febece00640 1 -- start start 2024-05-04T07:51:19.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.694+0000 7febece00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7febe8070c20 0x7febe815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.694+0000 7febece00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7febe80701b0 0x7febe815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.694+0000 7febece00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febe80cd3d0 con 0x7febe80d3890 2024-05-04T07:51:19.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.694+0000 7febece00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7febe80cdd00 con 0x7febe80701b0 2024-05-04T07:51:19.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.694+0000 7febece00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7febe806f500 con 0x7febe8070c20 2024-05-04T07:51:19.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7febe80701b0 0x7febe815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:19.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7febe80701b0 0x7febe815efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54498/0 (socket says 172.21.15.136:54498) 2024-05-04T07:51:19.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 -- 172.21.15.136:0/3940509744 learned_addr learned my addr 172.21.15.136:0/3940509744 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:19.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe7400640 1 --2- 172.21.15.136:0/3940509744 >> v2:172.21.15.142:3300/0 conn(0x7febe8070c20 0x7febe815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:19.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 -- 172.21.15.136:0/3940509744 >> v2:172.21.15.142:3300/0 conn(0x7febe8070c20 msgr2=0x7febe815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:19.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 --2- 172.21.15.136:0/3940509744 >> v2:172.21.15.142:3300/0 conn(0x7febe8070c20 0x7febe815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 -- 172.21.15.136:0/3940509744 >> v1:172.21.15.142:6789/0 conn(0x7febe80d3890 legacy=0x7febe80ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:19.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.695+0000 7febe6a00640 1 -- 172.21.15.136:0/3940509744 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe80cd6b0 con 0x7febe80701b0 2024-05-04T07:51:19.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.696+0000 7febe6a00640 1 --2- 172.21.15.136:0/3940509744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe80701b0 0x7febe815efc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febe80737d0 tx=0x7febd002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9830c940f5419d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:19.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febe6000640 1 -- 172.21.15.136:0/3940509744 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0036070 con 0x7febe80701b0 2024-05-04T07:51:19.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febe6000640 1 -- 172.21.15.136:0/3940509744 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd0031600 con 0x7febe80701b0 2024-05-04T07:51:19.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febe6000640 1 -- 172.21.15.136:0/3940509744 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd00319d0 con 0x7febe80701b0 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 -- 172.21.15.136:0/3940509744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe80701b0 msgr2=0x7febe815efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 --2- 172.21.15.136:0/3940509744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe80701b0 0x7febe815efc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febe80737d0 tx=0x7febd002a730 comp rx=0 tx=0).stop 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 -- 172.21.15.136:0/3940509744 shutdown_connections 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 --2- 172.21.15.136:0/3940509744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe80701b0 0x7febe815efc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 --2- 172.21.15.136:0/3940509744 >> v2:172.21.15.142:3300/0 conn(0x7febe8070c20 0x7febe815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.697+0000 7febece00640 1 -- 172.21.15.136:0/3940509744 >> 172.21.15.136:0/3940509744 conn(0x7febe80d2be0 msgr2=0x7febe80d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:19.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.698+0000 7febece00640 1 -- 172.21.15.136:0/3940509744 shutdown_connections 2024-05-04T07:51:19.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.698+0000 7febece00640 1 -- 172.21.15.136:0/3940509744 wait complete. 2024-05-04T07:51:19.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.699+0000 7febece00640 1 Processor -- start 2024-05-04T07:51:19.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.699+0000 7febece00640 1 -- start start 2024-05-04T07:51:19.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe80d3890 0x7febe815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe815c250 0x7febe8159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.705 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7febe806d4b0 con 0x7febe8070c20 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7febe815f500 con 0x7febe815c250 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.700+0000 7febece00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7febe806d630 con 0x7febe80d3890 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54508/0 (socket says 172.21.15.136:54508) 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 -- 172.21.15.136:0/1418464563 learned_addr learned my addr 172.21.15.136:0/1418464563 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:19.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 -- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe80d3890 msgr2=0x7febe815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe80d3890 0x7febe815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 -- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe815c250 msgr2=0x7febe8159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe815c250 0x7febe8159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 -- 172.21.15.136:0/1418464563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe815a4a0 con 0x7febe8070c20 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.701+0000 7febe7400640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7febd800d860 tx=0x7febd800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.702+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd800de50 con 0x7febe8070c20 2024-05-04T07:51:19.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.702+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd8019070 con 0x7febe8070c20 2024-05-04T07:51:19.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.702+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd800ba90 con 0x7febe8070c20 2024-05-04T07:51:19.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.702+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe815a780 con 0x7febe8070c20 2024-05-04T07:51:19.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.702+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe815ad40 con 0x7febe8070c20 2024-05-04T07:51:19.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.703+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe80713b0 con 0x7febe8070c20 2024-05-04T07:51:19.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.704+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7febd800bc30 con 0x7febe8070c20 2024-05-04T07:51:19.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.705+0000 7febdf400640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 0x7febc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:19.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.705+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7febd8097f10 con 0x7febe8070c20 2024-05-04T07:51:19.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.705+0000 7febe6a00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 0x7febc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:19.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.706+0000 7febe6a00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 0x7febc40787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febd0033000 tx=0x7febd002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:19.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.710+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7febd8061320 con 0x7febe8070c20 2024-05-04T07:51:19.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.932+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7febe8069b10 con 0x7febe8070c20 2024-05-04T07:51:19.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.933+0000 7febdf400640 1 -- 172.21.15.136:0/1418464563 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7febd8060c20 con 0x7febe8070c20 2024-05-04T07:51:19.934 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:51:19.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.936+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 msgr2=0x7febc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.936+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 0x7febc40787c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febd0033000 tx=0x7febd002e000 comp rx=0 tx=0).stop 2024-05-04T07:51:19.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.936+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 msgr2=0x7febe80c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.936+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7febd800d860 tx=0x7febd800dd20 comp rx=0 tx=0).stop 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 shutdown_connections 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7febc4076300 0x7febc40787c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febe815c250 0x7febe8159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7febe80d3890 0x7febe815bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 --2- 172.21.15.136:0/1418464563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7febe8070c20 0x7febe80c8740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 >> 172.21.15.136:0/1418464563 conn(0x7febe80d2be0 msgr2=0x7febe80b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 shutdown_connections 2024-05-04T07:51:19.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:19.937+0000 7febece00640 1 -- 172.21.15.136:0/1418464563 wait complete. 2024-05-04T07:51:19.957 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-04T07:51:19.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:19.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-04T07:51:20.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:51:20.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:20.050 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-04T07:51:20.109 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:20.109 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:20.166 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:20.166 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:20.216 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:20.216 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:20.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:51:20.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.472+0000 7f36b3000640 1 Processor -- start 2024-05-04T07:51:20.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.473+0000 7f36b3000640 1 -- start start 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.474+0000 7f36b3000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36ac145ad0 0x7f36ac0c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.474+0000 7f36b3000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36ac0ce5e0 0x7f36ac0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.474+0000 7f36b3000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ac0ccfa0 con 0x7f36ac0cb340 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.474+0000 7f36b3000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac145eb0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.474+0000 7f36b3000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f36ac0cd280 con 0x7f36ac145ad0 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36ac0ce5e0 0x7f36ac0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:20.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36ac0ce5e0 0x7f36ac0cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54514/0 (socket says 172.21.15.136:54514) 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 -- 172.21.15.136:0/2321155550 learned_addr learned my addr 172.21.15.136:0/2321155550 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b1c00640 1 --2- 172.21.15.136:0/2321155550 >> v2:172.21.15.142:3300/0 conn(0x7f36ac145ad0 0x7f36ac0c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 -- 172.21.15.136:0/2321155550 >> v2:172.21.15.142:3300/0 conn(0x7f36ac145ad0 msgr2=0x7f36ac0c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 --2- 172.21.15.136:0/2321155550 >> v2:172.21.15.142:3300/0 conn(0x7f36ac145ad0 0x7f36ac0c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 -- 172.21.15.136:0/2321155550 >> v1:172.21.15.142:6789/0 conn(0x7f36ac0cb340 legacy=0x7f36ac0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:20.476 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.475+0000 7f36b2600640 1 -- 172.21.15.136:0/2321155550 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac0d0460 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.477 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.476+0000 7f36b2600640 1 --2- 172.21.15.136:0/2321155550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0cea10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0719c0 tx=0x7f36a402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5e45119a994184 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.476+0000 7f36abe00640 1 -- 172.21.15.136:0/2321155550 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4036070 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36abe00640 1 -- 172.21.15.136:0/2321155550 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a4031600 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36abe00640 1 -- 172.21.15.136:0/2321155550 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a40319d0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 -- 172.21.15.136:0/2321155550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 msgr2=0x7f36ac0cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 --2- 172.21.15.136:0/2321155550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0cea10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0719c0 tx=0x7f36a402a6a0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 -- 172.21.15.136:0/2321155550 shutdown_connections 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 --2- 172.21.15.136:0/2321155550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0cea10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 --2- 172.21.15.136:0/2321155550 >> v2:172.21.15.142:3300/0 conn(0x7f36ac145ad0 0x7f36ac0c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 -- 172.21.15.136:0/2321155550 >> 172.21.15.136:0/2321155550 conn(0x7f36ac0cd490 msgr2=0x7f36ac0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 -- 172.21.15.136:0/2321155550 shutdown_connections 2024-05-04T07:51:20.478 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.477+0000 7f36b3000640 1 -- 172.21.15.136:0/2321155550 wait complete. 2024-05-04T07:51:20.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.479+0000 7f36b3000640 1 Processor -- start 2024-05-04T07:51:20.479 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.479+0000 7f36b3000640 1 -- start start 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ac0cb340 0x7f36ac15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ac145ad0 0x7f36ac0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0ccbc0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0c6f30 con 0x7f36ac0cb340 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b3000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0ccd40 con 0x7f36ac145ad0 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b1200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b1200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54520/0 (socket says 172.21.15.136:54520) 2024-05-04T07:51:20.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.480+0000 7f36b1200640 1 -- 172.21.15.136:0/2052400793 learned_addr learned my addr 172.21.15.136:0/2052400793 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:20.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 -- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ac145ad0 msgr2=0x7f36ac0ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ac145ad0 0x7f36ac0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 -- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ac0cb340 msgr2=0x7f36ac15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1c00640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ac0cb340 0x7f36ac15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ac0cb340 0x7f36ac15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 -- 172.21.15.136:0/2052400793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac15cf40 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b1200640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f369800c410 tx=0x7f369800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698017070 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36980035f0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698003a20 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.481+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac0c7fe0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.483 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.482+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac0c85a0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.483+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac069400 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.484+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3698003bc0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.485+0000 7f36a9600640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 0x7f368c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:20.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.485+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3698096cd0 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.485+0000 7f36b1c00640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 0x7f368c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:20.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.486+0000 7f36b1c00640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 0x7f368c0787c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b7c0 tx=0x7f36a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:20.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.489+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36ac15cf40 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.708+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f36ac0cff50 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.709 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.709+0000 7f36a9600640 1 -- 172.21.15.136:0/2052400793 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f3698068070 con 0x7f36ac0ce5e0 2024-05-04T07:51:20.709 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.711+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 msgr2=0x7f368c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.711+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 0x7f368c0787c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f36a000b7c0 tx=0x7f36a0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 msgr2=0x7f36ac0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f369800c410 tx=0x7f369800c8d0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 shutdown_connections 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f368c076300 0x7f368c0787c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f36ac145ad0 0x7f36ac0ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac0ce5e0 0x7f36ac0c9080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 --2- 172.21.15.136:0/2052400793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36ac0cb340 0x7f36ac15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 >> 172.21.15.136:0/2052400793 conn(0x7f36ac0cd490 msgr2=0x7f36ac140670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 shutdown_connections 2024-05-04T07:51:20.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:20.712+0000 7f36b3000640 1 -- 172.21.15.136:0/2052400793 wait complete. 2024-05-04T07:51:20.732 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-04T07:51:20.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:20.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-04T07:51:20.819 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:51:20.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:20.819 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-04T07:51:20.872 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:20.872 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:20.931 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:20.931 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:20.983 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:51:20.983 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:21.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:51:21.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.242+0000 7efd93000640 1 Processor -- start 2024-05-04T07:51:21.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.242+0000 7efd93000640 1 -- start start 2024-05-04T07:51:21.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.244+0000 7efd93000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efd8c0d1a50 0x7efd8c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.244+0000 7efd93000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efd8c0c9cc0 0x7efd8c15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.244+0000 7efd93000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c0d07d0 con 0x7efd8c0b6140 2024-05-04T07:51:21.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.244+0000 7efd93000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c0d0ab0 con 0x7efd8c0d1a50 2024-05-04T07:51:21.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.244+0000 7efd93000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c0d0d90 con 0x7efd8c0c9cc0 2024-05-04T07:51:21.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efd8c0d1a50 0x7efd8c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efd8c0d1a50 0x7efd8c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54524/0 (socket says 172.21.15.136:54524) 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 -- 172.21.15.136:0/3041169075 learned_addr learned my addr 172.21.15.136:0/3041169075 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd91000640 1 --2- 172.21.15.136:0/3041169075 >> v2:172.21.15.142:3300/0 conn(0x7efd8c0c9cc0 0x7efd8c15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 -- 172.21.15.136:0/3041169075 >> v2:172.21.15.142:3300/0 conn(0x7efd8c0c9cc0 msgr2=0x7efd8c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 --2- 172.21.15.136:0/3041169075 >> v2:172.21.15.142:3300/0 conn(0x7efd8c0c9cc0 0x7efd8c15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 -- 172.21.15.136:0/3041169075 >> v1:172.21.15.136:6789/0 conn(0x7efd8c0b6140 legacy=0x7efd8c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8b400640 1 -- 172.21.15.136:0/3041169075 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309372840 0 0) 0x7efd8c0d07d0 con 0x7efd8c0b6140 2024-05-04T07:51:21.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.245+0000 7efd8be00640 1 -- 172.21.15.136:0/3041169075 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c0d5eb0 con 0x7efd8c0d1a50 2024-05-04T07:51:21.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.246+0000 7efd8be00640 1 --2- 172.21.15.136:0/3041169075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0d1a50 0x7efd8c15f190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0cf660 tx=0x7efd7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbf75c808a13934 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd8b400640 1 -- 172.21.15.136:0/3041169075 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c037070 con 0x7efd8c0d1a50 2024-05-04T07:51:21.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd8b400640 1 -- 172.21.15.136:0/3041169075 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c032440 con 0x7efd8c0d1a50 2024-05-04T07:51:21.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd8b400640 1 -- 172.21.15.136:0/3041169075 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c032810 con 0x7efd8c0d1a50 2024-05-04T07:51:21.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 -- 172.21.15.136:0/3041169075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0d1a50 msgr2=0x7efd8c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 --2- 172.21.15.136:0/3041169075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0d1a50 0x7efd8c15f190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0cf660 tx=0x7efd7c02a270 comp rx=0 tx=0).stop 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 -- 172.21.15.136:0/3041169075 shutdown_connections 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 --2- 172.21.15.136:0/3041169075 >> v2:172.21.15.142:3300/0 conn(0x7efd8c0c9cc0 0x7efd8c15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 --2- 172.21.15.136:0/3041169075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0d1a50 0x7efd8c15f190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.247+0000 7efd93000640 1 -- 172.21.15.136:0/3041169075 >> 172.21.15.136:0/3041169075 conn(0x7efd8c0d5080 msgr2=0x7efd8c0d5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.248+0000 7efd93000640 1 -- 172.21.15.136:0/3041169075 shutdown_connections 2024-05-04T07:51:21.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.248+0000 7efd93000640 1 -- 172.21.15.136:0/3041169075 wait complete. 2024-05-04T07:51:21.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.249+0000 7efd93000640 1 Processor -- start 2024-05-04T07:51:21.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.249+0000 7efd93000640 1 -- start start 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c0c9cc0 0x7efd8c1f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8c0d1a50 0x7efd8c1618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0b6810 con 0x7efd8c0b6140 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0b6690 con 0x7efd8c0c9cc0 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.250+0000 7efd93000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c0d1e30 con 0x7efd8c0d1a50 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54526/0 (socket says 172.21.15.136:54526) 2024-05-04T07:51:21.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 -- 172.21.15.136:0/3997973321 learned_addr learned my addr 172.21.15.136:0/3997973321 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:21.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 -- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8c0d1a50 msgr2=0x7efd8c1618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8c0d1a50 0x7efd8c1618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 -- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c0c9cc0 msgr2=0x7efd8c1f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c0c9cc0 0x7efd8c1f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 -- 172.21.15.136:0/3997973321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c0cd9d0 con 0x7efd8c0b6140 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.251+0000 7efd8be00640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.252+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c041020 con 0x7efd8c0b6140 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.252+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c0306c0 con 0x7efd8c0b6140 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.252+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c037040 con 0x7efd8c0b6140 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.252+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c0cdcb0 con 0x7efd8c0b6140 2024-05-04T07:51:21.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.252+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c0ce270 con 0x7efd8c0b6140 2024-05-04T07:51:21.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.253+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c069450 con 0x7efd8c0b6140 2024-05-04T07:51:21.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.254+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd7c044020 con 0x7efd8c0b6140 2024-05-04T07:51:21.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.255+0000 7efd88c00640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 0x7efd68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.255+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efd7c0b8260 con 0x7efd8c0b6140 2024-05-04T07:51:21.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.255+0000 7efd83400640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 0x7efd68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.256+0000 7efd83400640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 0x7efd68078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c88d0 tx=0x7efd740078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.260+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd7c04b030 con 0x7efd8c0b6140 2024-05-04T07:51:21.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.481+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efd8c073ea0 con 0x7efd8c0b6140 2024-05-04T07:51:21.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.482+0000 7efd88c00640 1 -- 172.21.15.136:0/3997973321 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7efd7c081700 con 0x7efd8c0b6140 2024-05-04T07:51:21.482 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:51:21.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 msgr2=0x7efd68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 0x7efd68078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c88d0 tx=0x7efd740078f0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 msgr2=0x7efd8c15c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd7c000c00 tx=0x7efd7c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 shutdown_connections 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7efd680762d0 0x7efd68078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efd8c0d1a50 0x7efd8c1618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efd8c0c9cc0 0x7efd8c1f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 --2- 172.21.15.136:0/3997973321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8c0b6140 0x7efd8c15c720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 >> 172.21.15.136:0/3997973321 conn(0x7efd8c0d5080 msgr2=0x7efd8c15e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 shutdown_connections 2024-05-04T07:51:21.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.485+0000 7efd93000640 1 -- 172.21.15.136:0/3997973321 wait complete. 2024-05-04T07:51:21.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-04T07:51:21.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:21.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-04T07:51:21.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:51:21.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:21.602 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-04T07:51:21.655 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-04T07:51:21.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:21.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.838+0000 7f655de00640 1 Processor -- start 2024-05-04T07:51:21.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.838+0000 7f655de00640 1 -- start start 2024-05-04T07:51:21.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.839+0000 7f655de00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f65580cdc80 0x7f65581639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.839+0000 7f655de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f6558070400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.839+0000 7f655de00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65580d16b0 con 0x7f6558070940 2024-05-04T07:51:21.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.839+0000 7f655de00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6558162f10 con 0x7f65580cdc80 2024-05-04T07:51:21.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.839+0000 7f655de00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f65581631f0 con 0x7f6558073990 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6557400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6558070940 0x7f655806c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41762/0 (socket says 172.21.15.136:41762) 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6557400640 1 -- 172.21.15.136:0/1037109810 learned_addr learned my addr 172.21.15.136:0/1037109810 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556a00640 1 --2- 172.21.15.136:0/1037109810 >> v2:172.21.15.142:3300/0 conn(0x7f65580cdc80 0x7f65581639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f654fe00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f6558070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225637259 0 0) 0x7f65580d16b0 con 0x7f6558070940 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f653c003520 con 0x7f6558070940 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355278849 0 0) 0x7f653c003520 con 0x7f6558070940 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 msgr2=0x7f6558070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f6558070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 >> v2:172.21.15.142:3300/0 conn(0x7f65580cdc80 msgr2=0x7f65581639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:21.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.840+0000 7f6556000640 1 --2- 172.21.15.136:0/1037109810 >> v2:172.21.15.142:3300/0 conn(0x7f65580cdc80 0x7f65581639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65581634d0 con 0x7f6558070940 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f6550001a70 con 0x7f6558070940 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 >> v1:172.21.15.136:6789/0 conn(0x7f6558070940 legacy=0x7f655806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c003a70 0x7f653c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f653c004800 0x7f653c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f653c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6558162f10 con 0x7f653c004800 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65581631f0 con 0x7f653c003a70 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f653c00bac0 con 0x7f6558073990 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f653c004800 0x7f653c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6557400640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f653c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 -- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 msgr2=0x7f653c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f6556a00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c003a70 0x7f653c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6558073990 0x7f653c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 -- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c003a70 msgr2=0x7f653c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:21.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f653c003a70 0x7f653c003e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.844 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.841+0000 7f654fe00640 1 -- 172.21.15.136:0/1037109810 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c003520 con 0x7f653c004800 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.842+0000 7f654fe00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f653c004800 0x7f653c004c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6558163f30 tx=0x7f653c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b8b1c17e5d2642 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540036070 con 0x7f653c004800 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6540031400 con 0x7f653c004800 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f6556000640 1 -- 172.21.15.136:0/1037109810 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540009690 con 0x7f653c004800 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f655de00640 1 -- 172.21.15.136:0/1037109810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f653c004800 msgr2=0x7f653c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f655de00640 1 --2- 172.21.15.136:0/1037109810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f653c004800 0x7f653c004c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6558163f30 tx=0x7f653c005830 comp rx=0 tx=0).stop 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.843+0000 7f6557400640 1 -- 172.21.15.136:0/1037109810 reap_dead start 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.844+0000 7f655de00640 1 -- 172.21.15.136:0/1037109810 shutdown_connections 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.844+0000 7f655de00640 1 -- 172.21.15.136:0/1037109810 >> 172.21.15.136:0/1037109810 conn(0x7f65580d1ca0 msgr2=0x7f65580d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.844+0000 7f655de00640 1 -- 172.21.15.136:0/1037109810 shutdown_connections 2024-05-04T07:51:21.845 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.844+0000 7f655de00640 1 -- 172.21.15.136:0/1037109810 wait complete. 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.845+0000 7f655de00640 1 Processor -- start 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.846+0000 7f655de00640 1 -- start start 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.846+0000 7f655de00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c004800 0x7f65580c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.846+0000 7f655de00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.846+0000 7f655de00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 0x7f655815e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f655de00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f65580d1280 con 0x7f65580c6c30 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f655de00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65580d1990 con 0x7f655815dbf0 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f655de00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f65580d1400 con 0x7f653c004800 2024-05-04T07:51:21.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54548/0 (socket says 172.21.15.136:54548) 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 -- 172.21.15.136:0/722052287 learned_addr learned my addr 172.21.15.136:0/722052287 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f6557400640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 0x7f655815e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f6556a00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c004800 0x7f65580c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 -- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c004800 msgr2=0x7f65580c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c004800 0x7f65580c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 -- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 msgr2=0x7f655815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 0x7f655815e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f654fe00640 1 -- 172.21.15.136:0/722052287 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65580c5b90 con 0x7f65580c6c30 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.847+0000 7f6557400640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 0x7f655815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:21.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f654fe00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6540034040 tx=0x7f6540004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540040020 con 0x7f65580c6c30 2024-05-04T07:51:21.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f654003b6a0 con 0x7f65580c6c30 2024-05-04T07:51:21.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540036040 con 0x7f65580c6c30 2024-05-04T07:51:21.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65580c5e70 con 0x7f65580c6c30 2024-05-04T07:51:21.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.848+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65580c6430 con 0x7f65580c6c30 2024-05-04T07:51:21.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.850+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6558069400 con 0x7f65580c6c30 2024-05-04T07:51:21.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.851+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6540043020 con 0x7f65580c6c30 2024-05-04T07:51:21.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.852+0000 7f654f400640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 0x7f6534078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:21.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.852+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f65400b80b0 con 0x7f65580c6c30 2024-05-04T07:51:21.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.852+0000 7f6556a00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 0x7f6534078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:21.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.853+0000 7f6556a00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 0x7f6534078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6548009990 tx=0x7f6548008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:21.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:21.857+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f654004a030 con 0x7f65580c6c30 2024-05-04T07:51:22.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.099+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65580b7c20 con 0x7f65580c6c30 2024-05-04T07:51:22.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.100+0000 7f654f400640 1 -- 172.21.15.136:0/722052287 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f65400815e0 con 0x7f65580c6c30 2024-05-04T07:51:22.101 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:22.101 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:51:22.101 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.102+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 msgr2=0x7f6534078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 0x7f6534078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6548009990 tx=0x7f6548008040 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 msgr2=0x7f6558155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6540034040 tx=0x7f6540004730 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 shutdown_connections 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65340762d0 0x7f6534078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f655815dbf0 0x7f655815e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65580c6c30 0x7f6558155890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 --2- 172.21.15.136:0/722052287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f653c004800 0x7f65580c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 >> 172.21.15.136:0/722052287 conn(0x7f65580d1ca0 msgr2=0x7f65580b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 shutdown_connections 2024-05-04T07:51:22.104 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.103+0000 7f655de00640 1 -- 172.21.15.136:0/722052287 wait complete. 2024-05-04T07:51:22.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:22.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.302+0000 7fc387e00640 1 Processor -- start 2024-05-04T07:51:22.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.302+0000 7fc387e00640 1 -- start start 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.303+0000 7fc387e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3880d3460 0x7fc3880d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.303+0000 7fc387e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc3880b1c60 0x7fc3880d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.303+0000 7fc387e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3880d3d80 con 0x7fc3880b49e0 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.303+0000 7fc387e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc3880b2170 con 0x7fc3880b1c60 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.303+0000 7fc387e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc3880b2430 con 0x7fc3880d3460 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc3880b1c60 0x7fc3880d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc3880b1c60 0x7fc3880d59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54562/0 (socket says 172.21.15.136:54562) 2024-05-04T07:51:22.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 -- 172.21.15.136:0/1180686813 learned_addr learned my addr 172.21.15.136:0/1180686813 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:22.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc387400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc3880b49e0 0x7fc3880b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41768/0 (socket says 172.21.15.136:41768) 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386a00640 1 --2- 172.21.15.136:0/1180686813 >> v2:172.21.15.142:3300/0 conn(0x7fc3880d3460 0x7fc3880d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 -- 172.21.15.136:0/1180686813 >> v2:172.21.15.142:3300/0 conn(0x7fc3880d3460 msgr2=0x7fc3880d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 --2- 172.21.15.136:0/1180686813 >> v2:172.21.15.142:3300/0 conn(0x7fc3880d3460 0x7fc3880d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 -- 172.21.15.136:0/1180686813 >> v1:172.21.15.136:6789/0 conn(0x7fc3880b49e0 legacy=0x7fc3880b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc386000640 1 -- 172.21.15.136:0/1180686813 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3880b2710 con 0x7fc3880b1c60 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.304+0000 7fc385600640 1 -- 172.21.15.136:0/1180686813 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353304876 0 0) 0x7fc3880d3d80 con 0x7fc3880b49e0 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.305+0000 7fc386000640 1 --2- 172.21.15.136:0/1180686813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880b1c60 0x7fc3880d59c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc38806cc50 tx=0x7fc37402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d6c11492e3f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc385600640 1 -- 172.21.15.136:0/1180686813 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374037070 con 0x7fc3880b1c60 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc385600640 1 -- 172.21.15.136:0/1180686813 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc374032440 con 0x7fc3880b1c60 2024-05-04T07:51:22.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc385600640 1 -- 172.21.15.136:0/1180686813 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374032810 con 0x7fc3880b1c60 2024-05-04T07:51:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 -- 172.21.15.136:0/1180686813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880b1c60 msgr2=0x7fc3880d59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 --2- 172.21.15.136:0/1180686813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880b1c60 0x7fc3880d59c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc38806cc50 tx=0x7fc37402a1e0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 -- 172.21.15.136:0/1180686813 shutdown_connections 2024-05-04T07:51:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 --2- 172.21.15.136:0/1180686813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880b1c60 0x7fc3880d59c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 --2- 172.21.15.136:0/1180686813 >> v2:172.21.15.142:3300/0 conn(0x7fc3880d3460 0x7fc3880d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 -- 172.21.15.136:0/1180686813 >> 172.21.15.136:0/1180686813 conn(0x7fc38809e370 msgr2=0x7fc3880d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 -- 172.21.15.136:0/1180686813 shutdown_connections 2024-05-04T07:51:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.306+0000 7fc387e00640 1 -- 172.21.15.136:0/1180686813 wait complete. 2024-05-04T07:51:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.308+0000 7fc387e00640 1 Processor -- start 2024-05-04T07:51:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.308+0000 7fc387e00640 1 -- start start 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3880b1c60 0x7fc38815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3880b49e0 0x7fc3880ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880d5f00 con 0x7fc3880d3460 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc3880b2cd0 con 0x7fc3880b1c60 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc3880b4200 con 0x7fc3880b49e0 2024-05-04T07:51:22.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54564/0 (socket says 172.21.15.136:54564) 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc387400640 1 -- 172.21.15.136:0/889885060 learned_addr learned my addr 172.21.15.136:0/889885060 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.309+0000 7fc386a00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3880b1c60 0x7fc38815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc386000640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3880b49e0 0x7fc3880ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 -- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3880b49e0 msgr2=0x7fc3880ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3880b49e0 0x7fc3880ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 -- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3880b1c60 msgr2=0x7fc38815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3880b1c60 0x7fc38815d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 -- 172.21.15.136:0/889885060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3880cd2d0 con 0x7fc3880d3460 2024-05-04T07:51:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387400640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c6b0 tx=0x7fc38000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380018070 con 0x7fc3880d3460 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc380004da0 con 0x7fc3880d3460 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38000a880 con 0x7fc3880d3460 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3880cd5b0 con 0x7fc3880d3460 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.310+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3880cdb70 con 0x7fc3880d3460 2024-05-04T07:51:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.311+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc388069400 con 0x7fc3880d3460 2024-05-04T07:51:22.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.312+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc38000aa20 con 0x7fc3880d3460 2024-05-04T07:51:22.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.313+0000 7fc37ea00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 0x7fc368078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.313+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc380097070 con 0x7fc3880d3460 2024-05-04T07:51:22.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.314+0000 7fc386a00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 0x7fc368078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.314+0000 7fc386a00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 0x7fc368078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc37800b7c0 tx=0x7fc378008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.318+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc38005fe30 con 0x7fc3880d3460 2024-05-04T07:51:22.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.565+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc38808f120 con 0x7fc3880d3460 2024-05-04T07:51:22.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.566+0000 7fc37ea00640 1 -- 172.21.15.136:0/889885060 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7fc380064130 con 0x7fc3880d3460 2024-05-04T07:51:22.566 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:22.566 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:51:22.567 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 msgr2=0x7fc368078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 0x7fc368078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc37800b7c0 tx=0x7fc378008040 comp rx=0 tx=0).stop 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 msgr2=0x7fc38815ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c6b0 tx=0x7fc38000cb70 comp rx=0 tx=0).stop 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 shutdown_connections 2024-05-04T07:51:22.569 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc3680762d0 0x7fc368078790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3880d3460 0x7fc38815ad90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3880b49e0 0x7fc3880ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 --2- 172.21.15.136:0/889885060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3880b1c60 0x7fc38815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.568+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 >> 172.21.15.136:0/889885060 conn(0x7fc38809e370 msgr2=0x7fc38806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.569+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 shutdown_connections 2024-05-04T07:51:22.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.569+0000 7fc387e00640 1 -- 172.21.15.136:0/889885060 wait complete. 2024-05-04T07:51:22.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:22.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.768+0000 7fdf2e200640 1 Processor -- start 2024-05-04T07:51:22.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.768+0000 7fdf2e200640 1 -- start start 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf2e200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf2814cd70 0x7fdf280c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf2e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 0x7fdf280c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf2e200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf280cfe20 con 0x7fdf2814d150 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf2e200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdf280c75f0 con 0x7fdf2814cd70 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf2e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdf280c7030 con 0x7fdf280cbba0 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.770+0000 7fdf27400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf2814cd70 0x7fdf280c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf2814cd70 0x7fdf280c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54568/0 (socket says 172.21.15.136:54568) 2024-05-04T07:51:22.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 -- 172.21.15.136:0/4032046293 learned_addr learned my addr 172.21.15.136:0/4032046293 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 -- 172.21.15.136:0/4032046293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 msgr2=0x7fdf280c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27e00640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 0x7fdf280c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 0x7fdf280c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 -- 172.21.15.136:0/4032046293 >> v1:172.21.15.136:6789/0 conn(0x7fdf2814d150 legacy=0x7fdf280cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27400640 1 -- 172.21.15.136:0/4032046293 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf280c7310 con 0x7fdf2814cd70 2024-05-04T07:51:22.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.771+0000 7fdf27e00640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 0x7fdf280c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:22.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.772+0000 7fdf27400640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2814cd70 0x7fdf280c64c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf180098a0 tx=0x7fdf1802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d6733e8af7ff59 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.772+0000 7fdf26a00640 1 -- 172.21.15.136:0/4032046293 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18037070 con 0x7fdf2814cd70 2024-05-04T07:51:22.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.772+0000 7fdf26a00640 1 -- 172.21.15.136:0/4032046293 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18032440 con 0x7fdf2814cd70 2024-05-04T07:51:22.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.772+0000 7fdf26a00640 1 -- 172.21.15.136:0/4032046293 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18032810 con 0x7fdf2814cd70 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 -- 172.21.15.136:0/4032046293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2814cd70 msgr2=0x7fdf280c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2814cd70 0x7fdf280c64c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf180098a0 tx=0x7fdf1802a2a0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 -- 172.21.15.136:0/4032046293 shutdown_connections 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf280cbba0 0x7fdf280c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 --2- 172.21.15.136:0/4032046293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf2814cd70 0x7fdf280c64c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 -- 172.21.15.136:0/4032046293 >> 172.21.15.136:0/4032046293 conn(0x7fdf280d0c30 msgr2=0x7fdf280d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 -- 172.21.15.136:0/4032046293 shutdown_connections 2024-05-04T07:51:22.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.773+0000 7fdf2e200640 1 -- 172.21.15.136:0/4032046293 wait complete. 2024-05-04T07:51:22.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.775+0000 7fdf2e200640 1 Processor -- start 2024-05-04T07:51:22.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.776+0000 7fdf2e200640 1 -- start start 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf2814cd70 0x7fdf28073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2814d150 0x7fdf280739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28072890 con 0x7fdf280cbba0 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28072370 con 0x7fdf2814d150 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf2e200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdf28072a10 con 0x7fdf2814cd70 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf27400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf27400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54576/0 (socket says 172.21.15.136:54576) 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.777+0000 7fdf27400640 1 -- 172.21.15.136:0/2658303861 learned_addr learned my addr 172.21.15.136:0/2658303861 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf1fe00640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf2814cd70 0x7fdf28073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 -- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf2814cd70 msgr2=0x7fdf28073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf2814cd70 0x7fdf28073490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 -- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2814d150 msgr2=0x7fdf280739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27e00640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2814d150 0x7fdf280739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2814d150 0x7fdf280739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 -- 172.21.15.136:0/2658303861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf280b5660 con 0x7fdf280cbba0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf27400640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000c00 tx=0x7fdf180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18037040 con 0x7fdf280cbba0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf18042070 con 0x7fdf280cbba0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18030bd0 con 0x7fdf280cbba0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.778+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf28147890 con 0x7fdf280cbba0 2024-05-04T07:51:22.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.779+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf280b4570 con 0x7fdf280cbba0 2024-05-04T07:51:22.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.780+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf28069400 con 0x7fdf280cbba0 2024-05-04T07:51:22.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.781+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf18047460 con 0x7fdf280cbba0 2024-05-04T07:51:22.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.782+0000 7fdf1f400640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:22.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.782+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fdf180b8670 con 0x7fdf280cbba0 2024-05-04T07:51:22.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.783+0000 7fdf1fe00640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:22.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.783+0000 7fdf1fe00640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 0x7fdf04078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf280b2700 tx=0x7fdf10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:22.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.787+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdf18081b10 con 0x7fdf280cbba0 2024-05-04T07:51:22.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.995+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf280c67a0 con 0x7fdf280cbba0 2024-05-04T07:51:22.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:22.998+0000 7fdf1f400640 1 -- 172.21.15.136:0/2658303861 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+19010 (secure 0 0 0) 0x7fdf18081410 con 0x7fdf280cbba0 2024-05-04T07:51:22.999 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:22.999 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:08.784580+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:23.001 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 msgr2=0x7fdf04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 0x7fdf04078790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdf280b2700 tx=0x7fdf10009040 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 msgr2=0x7fdf281f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdf18000c00 tx=0x7fdf180046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 shutdown_connections 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdf040762d0 0x7fdf04078790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2814d150 0x7fdf280739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf2814cd70 0x7fdf28073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 --2- 172.21.15.136:0/2658303861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf280cbba0 0x7fdf281f9110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 >> 172.21.15.136:0/2658303861 conn(0x7fdf280d0c30 msgr2=0x7fdf2806e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 shutdown_connections 2024-05-04T07:51:23.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.001+0000 7fdf2e200640 1 -- 172.21.15.136:0/2658303861 wait complete. 2024-05-04T07:51:23.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-04T07:51:23.021 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:23.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.217+0000 7f13c3200640 1 Processor -- start 2024-05-04T07:51:23.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.217+0000 7f13c3200640 1 -- start start 2024-05-04T07:51:23.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.218+0000 7f13c3200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13bc15fd20 0x7f13bc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.218+0000 7f13c3200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13bc0b4c20 0x7f13bc169090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.218+0000 7f13c3200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc06c8e0 con 0x7f13bc160100 2024-05-04T07:51:23.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.218+0000 7f13c3200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc06cb60 con 0x7f13bc15fd20 2024-05-04T07:51:23.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.218+0000 7f13c3200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc06ce40 con 0x7f13bc0b4c20 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bbe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13bc15fd20 0x7f13bc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bb400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f13bc160100 0x7f13bc0b4510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41794/0 (socket says 172.21.15.136:41794) 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bb400640 1 -- 172.21.15.136:0/734755230 learned_addr learned my addr 172.21.15.136:0/734755230 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13c1200640 1 --2- 172.21.15.136:0/734755230 >> v2:172.21.15.142:3300/0 conn(0x7f13bc0b4c20 0x7f13bc169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bbe00640 1 -- 172.21.15.136:0/734755230 >> v2:172.21.15.142:3300/0 conn(0x7f13bc0b4c20 msgr2=0x7f13bc169090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bbe00640 1 --2- 172.21.15.136:0/734755230 >> v2:172.21.15.142:3300/0 conn(0x7f13bc0b4c20 0x7f13bc169090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bbe00640 1 -- 172.21.15.136:0/734755230 >> v1:172.21.15.136:6789/0 conn(0x7f13bc160100 legacy=0x7f13bc0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.219+0000 7f13bbe00640 1 -- 172.21.15.136:0/734755230 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc06d120 con 0x7f13bc15fd20 2024-05-04T07:51:23.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.221+0000 7f13bbe00640 1 --2- 172.21.15.136:0/734755230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc15fd20 0x7f13bc06c3a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13bc15d250 tx=0x7f13ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d13a44ed4e8709 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.221+0000 7f13baa00640 1 -- 172.21.15.136:0/734755230 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac037070 con 0x7f13bc15fd20 2024-05-04T07:51:23.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.221+0000 7f13baa00640 1 -- 172.21.15.136:0/734755230 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ac032440 con 0x7f13bc15fd20 2024-05-04T07:51:23.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.221+0000 7f13baa00640 1 -- 172.21.15.136:0/734755230 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac032810 con 0x7f13bc15fd20 2024-05-04T07:51:23.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 -- 172.21.15.136:0/734755230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc15fd20 msgr2=0x7f13bc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 --2- 172.21.15.136:0/734755230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc15fd20 0x7f13bc06c3a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13bc15d250 tx=0x7f13ac02a1a0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 -- 172.21.15.136:0/734755230 shutdown_connections 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 --2- 172.21.15.136:0/734755230 >> v2:172.21.15.142:3300/0 conn(0x7f13bc0b4c20 0x7f13bc169090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 --2- 172.21.15.136:0/734755230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc15fd20 0x7f13bc06c3a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 -- 172.21.15.136:0/734755230 >> 172.21.15.136:0/734755230 conn(0x7f13bc0d1560 msgr2=0x7f13bc0d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 -- 172.21.15.136:0/734755230 shutdown_connections 2024-05-04T07:51:23.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.222+0000 7f13c3200640 1 -- 172.21.15.136:0/734755230 wait complete. 2024-05-04T07:51:23.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.224+0000 7f13c3200640 1 Processor -- start 2024-05-04T07:51:23.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.224+0000 7f13c3200640 1 -- start start 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13bc15fd20 0x7f13bc1571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13bc160100 0x7f13bc157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc06dc00 con 0x7f13bc0b4c20 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc06d6e0 con 0x7f13bc160100 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13c3200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc160560 con 0x7f13bc15fd20 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54592/0 (socket says 172.21.15.136:54592) 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 -- 172.21.15.136:0/3265483261 learned_addr learned my addr 172.21.15.136:0/3265483261 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 -- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13bc15fd20 msgr2=0x7f13bc1571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13bc15fd20 0x7f13bc1571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 -- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13bc160100 msgr2=0x7f13bc157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13bc160100 0x7f13bc157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.225+0000 7f13bbe00640 1 -- 172.21.15.136:0/3265483261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc157eb0 con 0x7f13bc0b4c20 2024-05-04T07:51:23.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13bbe00640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000c00 tx=0x7f13ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac037040 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ac042070 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac030bd0 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc158190 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.226+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc158750 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.227+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc069400 con 0x7f13bc0b4c20 2024-05-04T07:51:23.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.228+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13ac047460 con 0x7f13bc0b4c20 2024-05-04T07:51:23.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.230+0000 7f13b3e00640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 0x7f139c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.231 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.230+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f13ac0b8680 con 0x7f13bc0b4c20 2024-05-04T07:51:23.231 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.230+0000 7f13bb400640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 0x7f139c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.231 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.231+0000 7f13bb400640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 0x7f139c078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005880 tx=0x7f13a8007a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.235+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13ac032e20 con 0x7f13bc0b4c20 2024-05-04T07:51:23.480 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.480+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13bc0d12d0 con 0x7f13bc0b4c20 2024-05-04T07:51:23.481 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.481+0000 7f13b3e00640 1 -- 172.21.15.136:0/3265483261 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f13ac081b20 con 0x7f13bc0b4c20 2024-05-04T07:51:23.482 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:23.482 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:51:23.482 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:51:23.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.483+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 msgr2=0x7f139c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.484 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.483+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 0x7f139c078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005880 tx=0x7f13a8007a20 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.483+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 msgr2=0x7f13bc0afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.483+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f13ac000c00 tx=0x7f13ac0046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 shutdown_connections 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f139c0762d0 0x7f139c078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13bc160100 0x7f13bc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13bc15fd20 0x7f13bc1571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 --2- 172.21.15.136:0/3265483261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13bc0b4c20 0x7f13bc0afdd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 >> 172.21.15.136:0/3265483261 conn(0x7f13bc0d1560 msgr2=0x7f13bc0727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 shutdown_connections 2024-05-04T07:51:23.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.484+0000 7f13c3200640 1 -- 172.21.15.136:0/3265483261 wait complete. 2024-05-04T07:51:23.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:23.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.707+0000 7f0c43e00640 1 Processor -- start 2024-05-04T07:51:23.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.708+0000 7f0c43e00640 1 -- start start 2024-05-04T07:51:23.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.709+0000 7f0c43e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c44163920 0x7f0c440ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.709+0000 7f0c43e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0c44071e50 0x7f0c440722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.709+0000 7f0c43e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440ccd20 con 0x7f0c440c3db0 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.709+0000 7f0c43e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440cd2a0 con 0x7f0c44071e50 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.709+0000 7f0c43e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4406ecf0 con 0x7f0c44163920 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0c44071e50 0x7f0c440722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c3be00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0c440c3db0 0x7f0c440cee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:41804/0 (socket says 172.21.15.136:41804) 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0c44071e50 0x7f0c440722e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54598/0 (socket says 172.21.15.136:54598) 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c3be00640 1 -- 172.21.15.136:0/840883598 learned_addr learned my addr 172.21.15.136:0/840883598 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c42a00640 1 --2- 172.21.15.136:0/840883598 >> v2:172.21.15.142:3300/0 conn(0x7f0c44163920 0x7f0c440ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 -- 172.21.15.136:0/840883598 >> v2:172.21.15.142:3300/0 conn(0x7f0c44163920 msgr2=0x7f0c440ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 --2- 172.21.15.136:0/840883598 >> v2:172.21.15.142:3300/0 conn(0x7f0c44163920 0x7f0c440ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 -- 172.21.15.136:0/840883598 >> v1:172.21.15.136:6789/0 conn(0x7f0c440c3db0 legacy=0x7f0c440cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c43400640 1 -- 172.21.15.136:0/840883598 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440ccfc0 con 0x7f0c44071e50 2024-05-04T07:51:23.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.710+0000 7f0c42000640 1 -- 172.21.15.136:0/840883598 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839287070 0 0) 0x7f0c440ccd20 con 0x7f0c440c3db0 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.711+0000 7f0c43400640 1 --2- 172.21.15.136:0/840883598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44071e50 0x7f0c440722e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406d300 tx=0x7f0c3c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70527e0dae5b13dc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.711+0000 7f0c42000640 1 -- 172.21.15.136:0/840883598 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c007740 con 0x7f0c44071e50 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.711+0000 7f0c42000640 1 -- 172.21.15.136:0/840883598 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c0078e0 con 0x7f0c44071e50 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c42000640 1 -- 172.21.15.136:0/840883598 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c007cb0 con 0x7f0c44071e50 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 -- 172.21.15.136:0/840883598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44071e50 msgr2=0x7f0c440722e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 --2- 172.21.15.136:0/840883598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44071e50 0x7f0c440722e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406d300 tx=0x7f0c3c02a5f0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 -- 172.21.15.136:0/840883598 shutdown_connections 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 --2- 172.21.15.136:0/840883598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44071e50 0x7f0c440722e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 --2- 172.21.15.136:0/840883598 >> v2:172.21.15.142:3300/0 conn(0x7f0c44163920 0x7f0c440ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 -- 172.21.15.136:0/840883598 >> 172.21.15.136:0/840883598 conn(0x7f0c440d09d0 msgr2=0x7f0c440d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 -- 172.21.15.136:0/840883598 shutdown_connections 2024-05-04T07:51:23.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.712+0000 7f0c43e00640 1 -- 172.21.15.136:0/840883598 wait complete. 2024-05-04T07:51:23.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.714+0000 7f0c43e00640 1 Processor -- start 2024-05-04T07:51:23.714 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.714+0000 7f0c43e00640 1 -- start start 2024-05-04T07:51:23.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44071e50 0x7f0c441504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440c3db0 0x7f0c440c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440cf520 con 0x7f0c44163920 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0c440cb430 con 0x7f0c44071e50 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0c440cf6a0 con 0x7f0c440c3db0 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54610/0 (socket says 172.21.15.136:54610) 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.715+0000 7f0c43400640 1 -- 172.21.15.136:0/3711910105 learned_addr learned my addr 172.21.15.136:0/3711910105 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c42a00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44071e50 0x7f0c441504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c3be00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440c3db0 0x7f0c440c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 -- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440c3db0 msgr2=0x7f0c440c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440c3db0 0x7f0c440c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 -- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44071e50 msgr2=0x7f0c441504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44071e50 0x7f0c441504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 -- 172.21.15.136:0/3711910105 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440c77f0 con 0x7f0c44163920 2024-05-04T07:51:23.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.716+0000 7f0c43400640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c02abe0 tx=0x7f0c3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.717+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c03f070 con 0x7f0c44163920 2024-05-04T07:51:23.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.717+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c031bc0 con 0x7f0c44163920 2024-05-04T07:51:23.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.717+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c044460 con 0x7f0c44163920 2024-05-04T07:51:23.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.717+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c440b47c0 con 0x7f0c44163920 2024-05-04T07:51:23.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.717+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c440b5000 con 0x7f0c44163920 2024-05-04T07:51:23.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.718+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44069400 con 0x7f0c44163920 2024-05-04T07:51:23.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.719+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0c3c007790 con 0x7f0c44163920 2024-05-04T07:51:23.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.720+0000 7f0c3aa00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 0x7f0c20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:23.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.720+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0c3c0b9360 con 0x7f0c44163920 2024-05-04T07:51:23.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.720+0000 7f0c42a00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 0x7f0c20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:23.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.721+0000 7f0c42a00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 0x7f0c20078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:23.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.725+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0c440b47c0 con 0x7f0c44163920 2024-05-04T07:51:23.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.970+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c440d0040 con 0x7f0c44163920 2024-05-04T07:51:23.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.971+0000 7f0c3aa00640 1 -- 172.21.15.136:0/3711910105 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5186 (secure 0 0 0) 0x7f0c3c082800 con 0x7f0c44163920 2024-05-04T07:51:23.972 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:23.972 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6836/3736897953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3736897953},{"type":"v1","addr":"172.21.15.136:6836","nonce":3736897953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/712751179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":712751179},{"type":"v1","addr":"172.21.15.136:6837","nonce":712751179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2423888111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2423888111},{"type":"v1","addr":"172.21.15.142:6835","nonce":2423888111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:50:26.961726+0000","modified":"2024-05-04T07:50:49.129516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6833/4269415671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":4269415671},{"type":"v1","addr":"172.21.15.142:6833","nonce":4269415671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4267,"qdb_cluster":[4267]},"id":1}]} 2024-05-04T07:51:23.972 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 9 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 msgr2=0x7f0c20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 0x7f0c20078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006fd0 tx=0x7f0c34008040 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 msgr2=0x7f0c440c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c02abe0 tx=0x7f0c3c004a40 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 shutdown_connections 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0c200762d0 0x7f0c20078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c44163920 0x7f0c440c6e80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c440c3db0 0x7f0c440c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 --2- 172.21.15.136:0/3711910105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c44071e50 0x7f0c441504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:23.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 >> 172.21.15.136:0/3711910105 conn(0x7f0c440d09d0 msgr2=0x7f0c440d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:23.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 shutdown_connections 2024-05-04T07:51:23.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:23.974+0000 7f0c43e00640 1 -- 172.21.15.136:0/3711910105 wait complete. 2024-05-04T07:51:23.994 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:24.195 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.195+0000 7f2705a00640 1 Processor -- start 2024-05-04T07:51:24.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.195+0000 7f2705a00640 1 -- start start 2024-05-04T07:51:24.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.196+0000 7f2705a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f270014cd70 0x7f27000c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f2705a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f27000cbba0 0x7f27000c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f2705a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27000cfe20 con 0x7f270014d150 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f2705a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f27000c75f0 con 0x7f27000cbba0 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f2705a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f27000c7030 con 0x7f270014cd70 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f26ff400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f27000cbba0 0x7f27000c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f26ff400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f27000cbba0 0x7f27000c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40380/0 (socket says 172.21.15.136:40380) 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f26ff400640 1 -- 172.21.15.136:0/3591383561 learned_addr learned my addr 172.21.15.136:0/3591383561 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:24.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.197+0000 7f26fea00640 1 --2- 172.21.15.136:0/3591383561 >> v2:172.21.15.142:3300/0 conn(0x7f270014cd70 0x7f27000c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.198+0000 7f26ff400640 1 -- 172.21.15.136:0/3591383561 >> v2:172.21.15.142:3300/0 conn(0x7f270014cd70 msgr2=0x7f27000c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.198+0000 7f26ff400640 1 --2- 172.21.15.136:0/3591383561 >> v2:172.21.15.142:3300/0 conn(0x7f270014cd70 0x7f27000c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.198+0000 7f26ff400640 1 -- 172.21.15.136:0/3591383561 >> v1:172.21.15.142:6789/0 conn(0x7f270014d150 legacy=0x7f27000cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.198+0000 7f26ff400640 1 -- 172.21.15.136:0/3591383561 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000c7310 con 0x7f27000cbba0 2024-05-04T07:51:24.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.199+0000 7f26ff400640 1 --2- 172.21.15.136:0/3591383561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27000cbba0 0x7f27000c6a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f268c183ad56a30 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.199+0000 7f26fe000640 1 -- 172.21.15.136:0/3591383561 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8036070 con 0x7f27000cbba0 2024-05-04T07:51:24.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.199+0000 7f26fe000640 1 -- 172.21.15.136:0/3591383561 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f8031600 con 0x7f27000cbba0 2024-05-04T07:51:24.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.199+0000 7f26fe000640 1 -- 172.21.15.136:0/3591383561 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80319d0 con 0x7f27000cbba0 2024-05-04T07:51:24.200 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 -- 172.21.15.136:0/3591383561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27000cbba0 msgr2=0x7f27000c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 --2- 172.21.15.136:0/3591383561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27000cbba0 0x7f27000c6a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009e50 tx=0x7f26f802a6c0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 -- 172.21.15.136:0/3591383561 shutdown_connections 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 --2- 172.21.15.136:0/3591383561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27000cbba0 0x7f27000c6a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 --2- 172.21.15.136:0/3591383561 >> v2:172.21.15.142:3300/0 conn(0x7f270014cd70 0x7f27000c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 -- 172.21.15.136:0/3591383561 >> 172.21.15.136:0/3591383561 conn(0x7f27000d0c30 msgr2=0x7f27000d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 -- 172.21.15.136:0/3591383561 shutdown_connections 2024-05-04T07:51:24.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.200+0000 7f2705a00640 1 -- 172.21.15.136:0/3591383561 wait complete. 2024-05-04T07:51:24.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.202+0000 7f2705a00640 1 Processor -- start 2024-05-04T07:51:24.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.202+0000 7f2705a00640 1 -- start start 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27000cbba0 0x7f2700148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270014cd70 0x7f27000ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2700072890 con 0x7f270014d150 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2700072370 con 0x7f27000cbba0 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f2705a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2700072a10 con 0x7f270014cd70 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40392/0 (socket says 172.21.15.136:40392) 2024-05-04T07:51:24.204 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 -- 172.21.15.136:0/2048219112 learned_addr learned my addr 172.21.15.136:0/2048219112 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26fea00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27000cbba0 0x7f2700148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26f7e00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270014cd70 0x7f27000ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 -- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270014cd70 msgr2=0x7f27000ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270014cd70 0x7f27000ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 -- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27000cbba0 msgr2=0x7f2700148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27000cbba0 0x7f2700148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.203+0000 7f26ff400640 1 -- 172.21.15.136:0/2048219112 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000c9600 con 0x7f270014d150 2024-05-04T07:51:24.205 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f26ff400640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009f70 tx=0x7f26f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8036050 con 0x7f270014d150 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f8042070 con 0x7f270014d150 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8009510 con 0x7f270014d150 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000cacb0 con 0x7f270014d150 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.204+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27000c8b20 con 0x7f270014d150 2024-05-04T07:51:24.206 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.206+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700069400 con 0x7f270014d150 2024-05-04T07:51:24.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.207+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f26f8007bd0 con 0x7f270014d150 2024-05-04T07:51:24.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.208+0000 7f26f6a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 0x7f26dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.208+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f26f80b87f0 con 0x7f270014d150 2024-05-04T07:51:24.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.208+0000 7f26fea00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 0x7f26dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.209+0000 7f26fea00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 0x7f26dc078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26f0006fd0 tx=0x7f26f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.212+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f26f8081dc0 con 0x7f270014d150 2024-05-04T07:51:24.423 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.422+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27000cda00 con 0x7f270014d150 2024-05-04T07:51:24.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.424+0000 7f26f6a00640 1 -- 172.21.15.136:0/2048219112 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+19010 (secure 0 0 0) 0x7f26f80816c0 con 0x7f270014d150 2024-05-04T07:51:24.425 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:24.425 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":26,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:08.784580+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:50:25.081524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T07:50:25.933776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-04T07:50:29.536357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:24.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.426+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 msgr2=0x7f26dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.426+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 0x7f26dc078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26f0006fd0 tx=0x7f26f0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.426+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 msgr2=0x7f2700146510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.426+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009f70 tx=0x7f26f8004a40 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 shutdown_connections 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f26dc0762d0 0x7f26dc078790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f270014d150 0x7f2700146510 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f270014cd70 0x7f27000ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 --2- 172.21.15.136:0/2048219112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27000cbba0 0x7f2700148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 >> 172.21.15.136:0/2048219112 conn(0x7f27000d0c30 msgr2=0x7f27000c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 shutdown_connections 2024-05-04T07:51:24.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.427+0000 7f2705a00640 1 -- 172.21.15.136:0/2048219112 wait complete. 2024-05-04T07:51:24.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-04T07:51:24.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.644+0000 7fd45cc00640 1 Processor -- start 2024-05-04T07:51:24.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.645+0000 7fd45cc00640 1 -- start start 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.646+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 0x7fd45806e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.646+0000 7fd45cc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4580d0440 con 0x7fd4580cff90 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.646+0000 7fd45cc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4580d06e0 con 0x7fd45815fae0 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.646+0000 7fd45cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd45806e7c0 con 0x7fd45806de30 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd44fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd4580cff90 0x7fd4580cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:50718/0 (socket says 172.21.15.136:50718) 2024-05-04T07:51:24.647 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd44fe00640 1 -- 172.21.15.136:0/3406533863 learned_addr learned my addr 172.21.15.136:0/3406533863 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd457e00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 0x7fd45806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280658387 0 0) 0x7fd4580d0440 con 0x7fd4580cff90 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd438003520 con 0x7fd4580cff90 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1543685032 0 0) 0x7fd438003520 con 0x7fd4580cff90 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 msgr2=0x7fd45806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:24.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 0x7fd45806e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.647+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 >> v1:172.21.15.142:6789/0 conn(0x7fd45815fae0 legacy=0x7fd45815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4580cea70 con 0x7fd4580cff90 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fd4400016f0 con 0x7fd4580cff90 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 >> v1:172.21.15.136:6789/0 conn(0x7fd4580cff90 legacy=0x7fd4580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003a30 0x7fd438003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd438004800 0x7fd438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 0x7fd438005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd45806e7c0 con 0x7fd438004800 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd43800bb80 con 0x7fd438003a30 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd43800bd80 con 0x7fd45806de30 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd438004800 0x7fd438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd457400640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003a30 0x7fd438003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 -- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 msgr2=0x7fd438005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:24.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd45806de30 0x7fd438005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 -- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003a30 msgr2=0x7fd438003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003a30 0x7fd438003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd44fe00640 1 -- 172.21.15.136:0/3406533863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd438003520 con 0x7fd438004800 2024-05-04T07:51:24.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.648+0000 7fd457400640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438003a30 0x7fd438003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.649+0000 7fd44fe00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd438004800 0x7fd438004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c2f0 tx=0x7fd438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18a4196318a0e5f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440007d90 con 0x7fd438004800 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440005af0 con 0x7fd438004800 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd456a00640 1 -- 172.21.15.136:0/3406533863 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440007070 con 0x7fd438004800 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 -- 172.21.15.136:0/3406533863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd438004800 msgr2=0x7fd438004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 --2- 172.21.15.136:0/3406533863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd438004800 0x7fd438004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c2f0 tx=0x7fd438005830 comp rx=0 tx=0).stop 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd457e00640 1 -- 172.21.15.136:0/3406533863 reap_dead start 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 -- 172.21.15.136:0/3406533863 shutdown_connections 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 -- 172.21.15.136:0/3406533863 >> 172.21.15.136:0/3406533863 conn(0x7fd4580cd490 msgr2=0x7fd4580cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 -- 172.21.15.136:0/3406533863 shutdown_connections 2024-05-04T07:51:24.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.650+0000 7fd45cc00640 1 -- 172.21.15.136:0/3406533863 wait complete. 2024-05-04T07:51:24.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.652+0000 7fd45cc00640 1 Processor -- start 2024-05-04T07:51:24.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.652+0000 7fd45cc00640 1 -- start start 2024-05-04T07:51:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004800 0x7fd4581f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 0x7fd458072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580ce690 con 0x7fd45814b8c0 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580cf030 con 0x7fd438004800 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd45cc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd4580ce810 con 0x7fd4580726b0 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.653+0000 7fd44fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40416/0 (socket says 172.21.15.136:40416) 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 -- 172.21.15.136:0/1736772335 learned_addr learned my addr 172.21.15.136:0/1736772335 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd457e00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 0x7fd458072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd457400640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004800 0x7fd4581f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 -- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 msgr2=0x7fd458072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 0x7fd458072b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 -- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004800 msgr2=0x7fd4581f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004800 0x7fd4581f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 -- 172.21.15.136:0/1736772335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd458159160 con 0x7fd45814b8c0 2024-05-04T07:51:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd457e00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 0x7fd458072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.654+0000 7fd44fe00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c2f0 tx=0x7fd4400019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.655+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400016b0 con 0x7fd45814b8c0 2024-05-04T07:51:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.655+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd440042070 con 0x7fd45814b8c0 2024-05-04T07:51:24.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.655+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440007290 con 0x7fd45814b8c0 2024-05-04T07:51:24.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.655+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd458159440 con 0x7fd45814b8c0 2024-05-04T07:51:24.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.655+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd458160050 con 0x7fd45814b8c0 2024-05-04T07:51:24.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.656+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458069400 con 0x7fd45814b8c0 2024-05-04T07:51:24.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.657+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd440007430 con 0x7fd45814b8c0 2024-05-04T07:51:24.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.659+0000 7fd44f400640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 0x7fd434078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:24.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.659+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd4400b7a30 con 0x7fd45814b8c0 2024-05-04T07:51:24.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.659+0000 7fd457400640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 0x7fd434078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:24.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.659+0000 7fd457400640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 0x7fd434078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd448000f60 tx=0x7fd448009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:24.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.663+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd440080f60 con 0x7fd45814b8c0 2024-05-04T07:51:24.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.910+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd4580ce330 con 0x7fd45814b8c0 2024-05-04T07:51:24.911 INFO:tasks.ceph.mon.a.smithi136.stderr:2024-05-04T07:51:24.911+0000 7f11a5600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-04T07:51:24.915 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.914+0000 7fd44f400640 1 -- 172.21.15.136:0/1736772335 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fd440080860 con 0x7fd45814b8c0 2024-05-04T07:51:24.915 INFO:teuthology.orchestra.run.smithi136.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-04T07:51:24.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.917+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 msgr2=0x7fd434078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.917+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 0x7fd434078790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd448000f60 tx=0x7fd448009040 comp rx=0 tx=0).stop 2024-05-04T07:51:24.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.917+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 msgr2=0x7fd4581587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:24.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.917+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd44000c2f0 tx=0x7fd4400019f0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 shutdown_connections 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd4340762d0 0x7fd434078790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4580726b0 0x7fd458072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd45814b8c0 0x7fd4581587f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 --2- 172.21.15.136:0/1736772335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd438004800 0x7fd4581f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 >> 172.21.15.136:0/1736772335 conn(0x7fd4580cd490 msgr2=0x7fd4580c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 shutdown_connections 2024-05-04T07:51:24.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:24.918+0000 7fd45cc00640 1 -- 172.21.15.136:0/1736772335 wait complete. 2024-05-04T07:51:24.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-04T07:51:24.950 INFO:tasks.ceph.mds.b.smithi142.stderr: -4912> 2024-05-04T07:50:32.445+0000 7f3559c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-04T07:51:25.031 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-05-04T07:51:25.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.139+0000 7f2121c00640 1 Processor -- start 2024-05-04T07:51:25.140 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.139+0000 7f2121c00640 1 -- start start 2024-05-04T07:51:25.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.140+0000 7f2121c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f211c06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.140+0000 7f2121c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0cc2b0 con 0x7f211c15ad40 2024-05-04T07:51:25.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.140+0000 7f2121c00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0701e0 con 0x7f211c072af0 2024-05-04T07:51:25.141 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.140+0000 7f2121c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f211c15df70 con 0x7f211c073d50 2024-05-04T07:51:25.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.141+0000 7f211aa00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f211c15ad40 0x7f211c0723e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:50730/0 (socket says 172.21.15.136:50730) 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.141+0000 7f211aa00640 1 -- 172.21.15.136:0/783027073 learned_addr learned my addr 172.21.15.136:0/783027073 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.141+0000 7f211b400640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f211c06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.141+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408644660 0 0) 0x7f211c0cc2b0 con 0x7f211c15ad40 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.141+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2100003520 con 0x7f211c15ad40 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 887962913 0 0) 0x7f2100003520 con 0x7f211c15ad40 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 msgr2=0x7f211c06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f211c06fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 >> v1:172.21.15.142:6789/0 conn(0x7f211c072af0 legacy=0x7f211c164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c15d640 con 0x7f211c15ad40 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f210c001a70 con 0x7f211c15ad40 2024-05-04T07:51:25.144 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 >> v1:172.21.15.136:6789/0 conn(0x7f211c15ad40 legacy=0x7f211c0723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f2100003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2100004050 0x7f2100004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100004d40 0x7f21000051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f210000bb80 con 0x7f2100004d40 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f210000bd30 con 0x7f2100004050 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f210000bf30 con 0x7f211c073d50 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f211b400640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100004d40 0x7f21000051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f211a000640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2100004050 0x7f2100004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f211aa00640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f2100003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.142+0000 7f211b400640 1 -- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 msgr2=0x7f2100003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:25.145 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.143+0000 7f211b400640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c073d50 0x7f2100003a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.143+0000 7f211b400640 1 -- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2100004050 msgr2=0x7f2100004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:25.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.143+0000 7f211b400640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2100004050 0x7f2100004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.143+0000 7f211b400640 1 -- 172.21.15.136:0/783027073 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2100003520 con 0x7f2100004d40 2024-05-04T07:51:25.146 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.143+0000 7f211a000640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2100004050 0x7f2100004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:25.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f211b400640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100004d40 0x7f21000051a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2114009a90 tx=0x7f2100005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a533a6222ef42279 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:25.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114036070 con 0x7f2100004d40 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114031400 con 0x7f2100004d40 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f2119600640 1 -- 172.21.15.136:0/783027073 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114009690 con 0x7f2100004d40 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f2121c00640 1 -- 172.21.15.136:0/783027073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100004d40 msgr2=0x7f21000051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f2121c00640 1 --2- 172.21.15.136:0/783027073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100004d40 0x7f21000051a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2114009a90 tx=0x7f2100005830 comp rx=0 tx=0).stop 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.144+0000 7f211b400640 1 -- 172.21.15.136:0/783027073 reap_dead start 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.145+0000 7f2121c00640 1 -- 172.21.15.136:0/783027073 shutdown_connections 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.145+0000 7f2121c00640 1 -- 172.21.15.136:0/783027073 >> 172.21.15.136:0/783027073 conn(0x7f211c0d0c50 msgr2=0x7f211c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.145+0000 7f2121c00640 1 -- 172.21.15.136:0/783027073 shutdown_connections 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.145+0000 7f2121c00640 1 -- 172.21.15.136:0/783027073 wait complete. 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.146+0000 7f2121c00640 1 Processor -- start 2024-05-04T07:51:25.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.146+0000 7f2121c00640 1 -- start start 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f211c14ff20 0x7f211c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c15ffc0 0x7f211c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f211c0731a0 con 0x7f211c0c8260 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f211c15dc00 con 0x7f211c14ff20 2024-05-04T07:51:25.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.147+0000 7f2121c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f211c15e400 con 0x7f211c15ffc0 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40442/0 (socket says 172.21.15.136:40442) 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 -- 172.21.15.136:0/532504812 learned_addr learned my addr 172.21.15.136:0/532504812 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 -- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c15ffc0 msgr2=0x7f211c1f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c15ffc0 0x7f211c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 -- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f211c14ff20 msgr2=0x7f211c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f211c14ff20 0x7f211c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 -- 172.21.15.136:0/532504812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0c8700 con 0x7f211c0c8260 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.148+0000 7f211a000640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f210400d7d0 tx=0x7f210400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.149+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104005270 con 0x7f211c0c8260 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.149+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2104017070 con 0x7f211c0c8260 2024-05-04T07:51:25.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.149+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210400b630 con 0x7f211c0c8260 2024-05-04T07:51:25.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.149+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c0c89e0 con 0x7f211c0c8260 2024-05-04T07:51:25.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.149+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c0c9980 con 0x7f211c0c8260 2024-05-04T07:51:25.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.150+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211c160410 con 0x7f211c0c8260 2024-05-04T07:51:25.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.151+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f210400b7d0 con 0x7f211c0c8260 2024-05-04T07:51:25.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.152+0000 7f2112a00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 0x7f20f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:25.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.152+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f2104097a20 con 0x7f211c0c8260 2024-05-04T07:51:25.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.152+0000 7f211aa00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 0x7f20f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:25.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.153+0000 7f211aa00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 0x7f20f8078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f210c001be0 tx=0x7f210c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:25.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.157+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2104060ef0 con 0x7f211c0c8260 2024-05-04T07:51:25.409 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.409+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f211c069470 con 0x7f211c0c8260 2024-05-04T07:51:25.919 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.918+0000 7f2112a00640 1 -- 172.21.15.136:0/532504812 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f21040607f0 con 0x7f211c0c8260 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.921+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 msgr2=0x7f20f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.921+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 0x7f20f8078790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f210c001be0 tx=0x7f210c009040 comp rx=0 tx=0).stop 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 msgr2=0x7f211c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f210400d7d0 tx=0x7f210400dc90 comp rx=0 tx=0).stop 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 shutdown_connections 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f20f80762d0 0x7f20f8078790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f211c15ffc0 0x7f211c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f211c0c8260 0x7f211c15fa80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 --2- 172.21.15.136:0/532504812 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f211c14ff20 0x7f211c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:25.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 >> 172.21.15.136:0/532504812 conn(0x7f211c0d0c50 msgr2=0x7f211c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:25.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 shutdown_connections 2024-05-04T07:51:25.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:25.922+0000 7f2121c00640 1 -- 172.21.15.136:0/532504812 wait complete. 2024-05-04T07:51:25.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-04T07:51:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.152+0000 7f4e92a00640 1 Processor -- start 2024-05-04T07:51:26.153 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.153+0000 7f4e92a00640 1 -- start start 2024-05-04T07:51:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c162a10 0x7f4e8c0d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4e8c0b6010 0x7f4e8c0d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c0d3f50 con 0x7f4e8c162a10 2024-05-04T07:51:26.155 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c0b7eb0 con 0x7f4e8c0b6010 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e92a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c0d06b0 con 0x7f4e8c0d3ae0 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e8be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c162a10 0x7f4e8c0d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e8be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e8c162a10 0x7f4e8c0d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40454/0 (socket says 172.21.15.136:40454) 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.154+0000 7f4e8be00640 1 -- 172.21.15.136:0/2401572077 learned_addr learned my addr 172.21.15.136:0/2401572077 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.155+0000 7f4e8be00640 1 -- 172.21.15.136:0/2401572077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 msgr2=0x7f4e8c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.155+0000 7f4e8be00640 1 --2- 172.21.15.136:0/2401572077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.155+0000 7f4e8be00640 1 -- 172.21.15.136:0/2401572077 >> v2:172.21.15.142:3300/0 conn(0x7f4e8c0b6010 msgr2=0x7f4e8c0d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.155+0000 7f4e8be00640 1 --2- 172.21.15.136:0/2401572077 >> v2:172.21.15.142:3300/0 conn(0x7f4e8c0b6010 0x7f4e8c0d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.155+0000 7f4e8be00640 1 -- 172.21.15.136:0/2401572077 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0d0930 con 0x7f4e8c162a10 2024-05-04T07:51:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.156+0000 7f4e8be00640 1 --2- 172.21.15.136:0/2401572077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0d2da0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c076820 tx=0x7f4e7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0a8d8337b7ad server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.156+0000 7f4e8aa00640 1 -- 172.21.15.136:0/2401572077 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c037070 con 0x7f4e8c162a10 2024-05-04T07:51:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.156+0000 7f4e8aa00640 1 -- 172.21.15.136:0/2401572077 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c032440 con 0x7f4e8c162a10 2024-05-04T07:51:26.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.156+0000 7f4e8aa00640 1 -- 172.21.15.136:0/2401572077 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c032810 con 0x7f4e8c162a10 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 -- 172.21.15.136:0/2401572077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c162a10 msgr2=0x7f4e8c0d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 --2- 172.21.15.136:0/2401572077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0d2da0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c076820 tx=0x7f4e7c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 -- 172.21.15.136:0/2401572077 shutdown_connections 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 --2- 172.21.15.136:0/2401572077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 --2- 172.21.15.136:0/2401572077 >> v2:172.21.15.142:3300/0 conn(0x7f4e8c0b6010 0x7f4e8c0d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 --2- 172.21.15.136:0/2401572077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0d2da0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 -- 172.21.15.136:0/2401572077 >> 172.21.15.136:0/2401572077 conn(0x7f4e8c0d4fc0 msgr2=0x7f4e8c0d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:26.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 -- 172.21.15.136:0/2401572077 shutdown_connections 2024-05-04T07:51:26.159 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.157+0000 7f4e92a00640 1 -- 172.21.15.136:0/2401572077 wait complete. 2024-05-04T07:51:26.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.159+0000 7f4e92a00640 1 Processor -- start 2024-05-04T07:51:26.160 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.160+0000 7f4e92a00640 1 -- start start 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0d0ef0 con 0x7f4e8c0b6010 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b8120 con 0x7f4e8c162a10 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e92a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c162df0 con 0x7f4e8c0d3ae0 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:26.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40470/0 (socket says 172.21.15.136:40470) 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 -- 172.21.15.136:0/3135598700 learned_addr learned my addr 172.21.15.136:0/3135598700 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 -- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 msgr2=0x7f4e8c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 -- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e8c162a10 msgr2=0x7f4e8c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.161+0000 7f4e8be00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e8be00640 1 -- 172.21.15.136:0/3135598700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0b9e00 con 0x7f4e8c0b6010 2024-05-04T07:51:26.163 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e8be00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c000c00 tx=0x7f4e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c041070 con 0x7f4e8c0b6010 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c03c870 con 0x7f4e8c0b6010 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c037040 con 0x7f4e8c0b6010 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c1f4e70 con 0x7f4e8c0b6010 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.162+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c0ce650 con 0x7f4e8c0b6010 2024-05-04T07:51:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.164+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8c0694e0 con 0x7f4e8c0b6010 2024-05-04T07:51:26.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.165+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e7c044070 con 0x7f4e8c0b6010 2024-05-04T07:51:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.166+0000 7f4e83e00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 0x7f4e68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.166+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f4e7c0b8560 con 0x7f4e8c0b6010 2024-05-04T07:51:26.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.166+0000 7f4e8b400640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 0x7f4e68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:26.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.167+0000 7f4e8b400640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 0x7f4e68078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c15c8e0 tx=0x7f4e74009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:26.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.171+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e7c081ad0 con 0x7f4e8c0b6010 2024-05-04T07:51:26.380 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.380+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e8c075070 con 0x7f4e8c0b6010 2024-05-04T07:51:26.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.930+0000 7f4e83e00640 1 -- 172.21.15.136:0/3135598700 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f4e7c0813d0 con 0x7f4e8c0b6010 2024-05-04T07:51:26.932 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' removed 2024-05-04T07:51:26.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.934+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 msgr2=0x7f4e68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:26.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.934+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 0x7f4e68078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c15c8e0 tx=0x7f4e74009250 comp rx=0 tx=0).stop 2024-05-04T07:51:26.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.934+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 msgr2=0x7f4e8c15c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:26.935 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.934+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c000c00 tx=0x7f4e7c0046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 shutdown_connections 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e680762d0 0x7f4e68078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e8c162a10 0x7f4e8c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e8c0d3ae0 0x7f4e8c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 --2- 172.21.15.136:0/3135598700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e8c0b6010 0x7f4e8c15c3a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:26.936 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.935+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 >> 172.21.15.136:0/3135598700 conn(0x7f4e8c0d4fc0 msgr2=0x7f4e8c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:26.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.936+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 shutdown_connections 2024-05-04T07:51:26.937 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:26.936+0000 7f4e92a00640 1 -- 172.21.15.136:0/3135598700 wait complete. 2024-05-04T07:51:26.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-04T07:51:27.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.165+0000 7ff057000640 1 Processor -- start 2024-05-04T07:51:27.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.165+0000 7ff057000640 1 -- start start 2024-05-04T07:51:27.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.167+0000 7ff057000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 0x7ff0500d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.167+0000 7ff057000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.167+0000 7ff057000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0500d0c70 con 0x7ff0500d5a50 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.167+0000 7ff057000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff0500d0f50 con 0x7ff050162850 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.167+0000 7ff057000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0500b7f20 con 0x7ff050162c30 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.168+0000 7ff055200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.168+0000 7ff055c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 0x7ff0500d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.168+0000 7ff055200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:45430/0 (socket says 172.21.15.136:45430) 2024-05-04T07:51:27.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.168+0000 7ff055200640 1 -- 172.21.15.136:0/3343987919 learned_addr learned my addr 172.21.15.136:0/3343987919 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:27.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.169+0000 7ff055200640 1 -- 172.21.15.136:0/3343987919 >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 msgr2=0x7ff0500d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:27.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.169+0000 7ff055200640 1 --2- 172.21.15.136:0/3343987919 >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 0x7ff0500d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.169+0000 7ff055200640 1 -- 172.21.15.136:0/3343987919 >> v1:172.21.15.142:6789/0 conn(0x7ff0500d5a50 legacy=0x7ff0500d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.169+0000 7ff055200640 1 -- 172.21.15.136:0/3343987919 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0500b8200 con 0x7ff050162c30 2024-05-04T07:51:27.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.169+0000 7ff055c00640 1 --2- 172.21.15.136:0/3343987919 >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 0x7ff0500d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:51:27.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.170+0000 7ff055200640 1 --2- 172.21.15.136:0/3343987919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff040009e50 tx=0x7ff04002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=811df88d28dc4fbe server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:27.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.170+0000 7ff04fe00640 1 -- 172.21.15.136:0/3343987919 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040036070 con 0x7ff050162c30 2024-05-04T07:51:27.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff04fe00640 1 -- 172.21.15.136:0/3343987919 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff040031600 con 0x7ff050162c30 2024-05-04T07:51:27.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff04fe00640 1 -- 172.21.15.136:0/3343987919 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0400319d0 con 0x7ff050162c30 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 -- 172.21.15.136:0/3343987919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 msgr2=0x7ff0500d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 --2- 172.21.15.136:0/3343987919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff040009e50 tx=0x7ff04002a5f0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 -- 172.21.15.136:0/3343987919 shutdown_connections 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 --2- 172.21.15.136:0/3343987919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff050162c30 0x7ff0500d1ad0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 --2- 172.21.15.136:0/3343987919 >> v2:172.21.15.142:3300/0 conn(0x7ff050162850 0x7ff0500d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 -- 172.21.15.136:0/3343987919 >> 172.21.15.136:0/3343987919 conn(0x7ff0500d4f30 msgr2=0x7ff0500d5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 -- 172.21.15.136:0/3343987919 shutdown_connections 2024-05-04T07:51:27.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.171+0000 7ff057000640 1 -- 172.21.15.136:0/3343987919 wait complete. 2024-05-04T07:51:27.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.173+0000 7ff057000640 1 Processor -- start 2024-05-04T07:51:27.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.173+0000 7ff057000640 1 -- start start 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0500d5a50 0x7ff0501f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff050162850 0x7ff0500ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff0500b9a10 con 0x7ff050162c30 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0500d2210 con 0x7ff050162850 2024-05-04T07:51:27.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.174+0000 7ff057000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0500b9b90 con 0x7ff0500d5a50 2024-05-04T07:51:27.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40472/0 (socket says 172.21.15.136:40472) 2024-05-04T07:51:27.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 -- 172.21.15.136:0/3619535828 learned_addr learned my addr 172.21.15.136:0/3619535828 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:27.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff055c00640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0500d5a50 0x7ff0501f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff055200640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff050162850 0x7ff0500ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 -- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0500d5a50 msgr2=0x7ff0501f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0500d5a50 0x7ff0501f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 -- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff050162850 msgr2=0x7ff0500ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff050162850 0x7ff0500ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.175+0000 7ff056600640 1 -- 172.21.15.136:0/3619535828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05009f160 con 0x7ff050162c30 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff056600640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c400 tx=0x7ff04800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048017070 con 0x7ff050162c30 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0480052d0 con 0x7ff050162c30 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05009f440 con 0x7ff050162c30 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0480037f0 con 0x7ff050162c30 2024-05-04T07:51:27.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.176+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05009fa00 con 0x7ff050162c30 2024-05-04T07:51:27.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.177+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff050069400 con 0x7ff050162c30 2024-05-04T07:51:27.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.178+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff04801a070 con 0x7ff050162c30 2024-05-04T07:51:27.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.180+0000 7ff04d600640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 0x7ff0340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:27.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.180+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7ff048096b60 con 0x7ff050162c30 2024-05-04T07:51:27.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.180+0000 7ff055c00640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 0x7ff0340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:27.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.181+0000 7ff055c00640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 0x7ff0340787c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff044009560 tx=0x7ff044008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:27.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.184+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff04805fbb0 con 0x7ff050162c30 2024-05-04T07:51:27.401 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.401+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff0500d06e0 con 0x7ff050162c30 2024-05-04T07:51:27.943 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.942+0000 7ff04d600640 1 -- 172.21.15.136:0/3619535828 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7ff0480681f0 con 0x7ff050162c30 2024-05-04T07:51:27.943 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' removed 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.947+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 msgr2=0x7ff0340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.947+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 0x7ff0340787c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff044009560 tx=0x7ff044008040 comp rx=0 tx=0).stop 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.947+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 msgr2=0x7ff0500a21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.947+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c400 tx=0x7ff04800c8c0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.948+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 shutdown_connections 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.948+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff034076300 0x7ff0340787c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.948+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff050162c30 0x7ff0500a21c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.949+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff050162850 0x7ff0500ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.949 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.949+0000 7ff057000640 1 --2- 172.21.15.136:0/3619535828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0500d5a50 0x7ff0501f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:27.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.949+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 >> 172.21.15.136:0/3619535828 conn(0x7ff0500d4f30 msgr2=0x7ff0500ba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:27.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.949+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 shutdown_connections 2024-05-04T07:51:27.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:27.949+0000 7ff057000640 1 -- 172.21.15.136:0/3619535828 wait complete. 2024-05-04T07:51:27.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-04T07:51:28.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.165+0000 7f45b6c00640 1 Processor -- start 2024-05-04T07:51:28.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.166+0000 7f45b6c00640 1 -- start start 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45b6c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 0x7f45b00d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45b6c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45b00d3cb0 0x7f45b00b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45b6c00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b00b7eb0 con 0x7f45b00b6010 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45b6c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f45b00d06b0 con 0x7f45b00d3cb0 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45b6c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f45b00d0930 con 0x7f45b0162a10 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45af400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f45b00b6010 0x7f45b00d35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:50740/0 (socket says 172.21.15.136:50740) 2024-05-04T07:51:28.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.167+0000 7f45af400640 1 -- 172.21.15.136:0/1002855911 learned_addr learned my addr 172.21.15.136:0/1002855911 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45afe00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 0x7f45b00d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258518101 0 0) 0x7f45b00b7eb0 con 0x7f45b00b6010 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45b4c00640 1 --2- 172.21.15.136:0/1002855911 >> v2:172.21.15.142:3300/0 conn(0x7f45b00d3cb0 0x7f45b00b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4594003520 con 0x7f45b00b6010 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 273435827 0 0) 0x7f4594003520 con 0x7f45b00b6010 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 msgr2=0x7f45b00d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 0x7f45b00d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 >> v2:172.21.15.142:3300/0 conn(0x7f45b00d3cb0 msgr2=0x7f45b00b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 --2- 172.21.15.136:0/1002855911 >> v2:172.21.15.142:3300/0 conn(0x7f45b00d3cb0 0x7f45b00b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b00d0c10 con 0x7f45b00b6010 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f45980016f0 con 0x7f45b00b6010 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 >> v1:172.21.15.136:6789/0 conn(0x7f45b00b6010 legacy=0x7f45b00d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4594003a50 0x7f4594003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594004800 0x7f4594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.168+0000 7f45aea00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 0x7f45940051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45b00d06b0 con 0x7f4594003a50 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f45b00d0930 con 0x7f4594004800 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f459400bb50 con 0x7f45b0162a10 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4594003a50 0x7f4594003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45af400640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594004800 0x7f4594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 -- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 msgr2=0x7f45940051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:28.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0162a10 0x7f45940051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 -- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594004800 msgr2=0x7f4594004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:28.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594004800 0x7f4594004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.169+0000 7f45afe00640 1 -- 172.21.15.136:0/1002855911 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4594003520 con 0x7f4594003a50 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.170+0000 7f45afe00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4594003a50 0x7f4594003e70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f45a8007360 tx=0x7f4594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dcfa08a3d5fe7b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.170+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8009be0 con 0x7f4594003a50 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a802e620 con 0x7f4594003a50 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45aea00640 1 -- 172.21.15.136:0/1002855911 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a802e9f0 con 0x7f4594003a50 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 -- 172.21.15.136:0/1002855911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4594003a50 msgr2=0x7f4594003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 --2- 172.21.15.136:0/1002855911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4594003a50 0x7f4594003e70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f45a8007360 tx=0x7f4594005830 comp rx=0 tx=0).stop 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b4c00640 1 -- 172.21.15.136:0/1002855911 reap_dead start 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 -- 172.21.15.136:0/1002855911 shutdown_connections 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 -- 172.21.15.136:0/1002855911 >> 172.21.15.136:0/1002855911 conn(0x7f45b00d4fc0 msgr2=0x7f45b00d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 -- 172.21.15.136:0/1002855911 shutdown_connections 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.171+0000 7f45b6c00640 1 -- 172.21.15.136:0/1002855911 wait complete. 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.173+0000 7f45b6c00640 1 Processor -- start 2024-05-04T07:51:28.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.173+0000 7f45b6c00640 1 -- start start 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 0x7f45b01f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b015c540 0x7f45b00b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45b0162df0 con 0x7f45b00ba160 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f45b00d0ef0 con 0x7f4594003a50 2024-05-04T07:51:28.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b6c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f45b00d2da0 con 0x7f45b015c540 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b4c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:40496/0 (socket says 172.21.15.136:40496) 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.174+0000 7f45b4c00640 1 -- 172.21.15.136:0/2604289150 learned_addr learned my addr 172.21.15.136:0/2604289150 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45afe00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 0x7f45b01f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 -- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b015c540 msgr2=0x7f45b00b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45af400640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b015c540 0x7f45b00b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b015c540 0x7f45b00b9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 -- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 msgr2=0x7f45b01f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 0x7f45b01f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 -- 172.21.15.136:0/2604289150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b01f5e00 con 0x7f45b00ba160 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45afe00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 0x7f45b01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45b4c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f45b00767f0 tx=0x7f45a000d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:28.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0004020 con 0x7f45b00ba160 2024-05-04T07:51:28.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.175+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a00041c0 con 0x7f45b00ba160 2024-05-04T07:51:28.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.176+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a00043f0 con 0x7f45b00ba160 2024-05-04T07:51:28.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.176+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b01f5b20 con 0x7f45b00ba160 2024-05-04T07:51:28.182 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.176+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b01f88b0 con 0x7f45b00ba160 2024-05-04T07:51:28.183 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.177+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b00694e0 con 0x7f45b00ba160 2024-05-04T07:51:28.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.178+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f45a001a020 con 0x7f45b00ba160 2024-05-04T07:51:28.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.179+0000 7f45a7e00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 0x7f458c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:28.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.179+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f45a0096d30 con 0x7f45b00ba160 2024-05-04T07:51:28.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.179+0000 7f45afe00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 0x7f458c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:28.184 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.180+0000 7f45afe00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 0x7f458c078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f45a8035000 tx=0x7f45a8038040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:28.185 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.184+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45a00605f0 con 0x7f45b00ba160 2024-05-04T07:51:28.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.397+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45b00d3380 con 0x7f45b00ba160 2024-05-04T07:51:28.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.955+0000 7f45a7e00640 1 -- 172.21.15.136:0/2604289150 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f45a005fef0 con 0x7f45b00ba160 2024-05-04T07:51:28.956 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data_ec' removed 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 msgr2=0x7f458c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 0x7f458c078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f45a8035000 tx=0x7f45a8038040 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 msgr2=0x7f45b01f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f45b00767f0 tx=0x7f45a000d820 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 shutdown_connections 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f458c0762d0 0x7f458c078790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b00ba160 0x7f45b01f4f40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b015c540 0x7f45b00b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 --2- 172.21.15.136:0/2604289150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4594003a50 0x7f45b01f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:28.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 >> 172.21.15.136:0/2604289150 conn(0x7f45b00d4fc0 msgr2=0x7f45b0160be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:28.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 shutdown_connections 2024-05-04T07:51:28.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:28.959+0000 7f45b6c00640 1 -- 172.21.15.136:0/2604289150 wait complete. 2024-05-04T07:51:28.984 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-04T07:51:28.984 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-04T07:51:28.984 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-04T07:51:28.984 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:51:28.985 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-04T07:51:28.985 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-04T07:51:28.985 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-04T07:51:28.985 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:51:28.985 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-04T07:51:28.985 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-04T07:51:28.985 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-04T07:51:28.986 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:51:28.986 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-04T07:51:28.986 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-04T07:51:28.986 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-04T07:51:28.986 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:51:29.005 INFO:tasks.ceph.mds.c:Stopped 2024-05-04T07:51:29.005 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-04T07:51:29.007 INFO:tasks.ceph.mds.b:Stopped 2024-05-04T07:51:29.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-04T07:51:29.008 INFO:tasks.ceph.mds.d:Stopped 2024-05-04T07:51:29.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-04T07:51:29.052 INFO:tasks.ceph.mds.c:Started 2024-05-04T07:51:29.052 DEBUG:teuthology.parallel:result is None 2024-05-04T07:51:29.053 INFO:tasks.ceph.mds.b:Started 2024-05-04T07:51:29.053 DEBUG:teuthology.parallel:result is None 2024-05-04T07:51:29.057 INFO:tasks.ceph.mds.d:Started 2024-05-04T07:51:29.058 DEBUG:teuthology.parallel:result is None 2024-05-04T07:51:29.203 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-05-04T07:51:29.204 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-05-04T07:51:29.221 INFO:tasks.ceph.mds.c.smithi136.stdout:starting mds.c at 2024-05-04T07:51:33.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-04T07:51:35.003 INFO:tasks.ceph.mds.a:Stopped 2024-05-04T07:51:35.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-04T07:51:35.012 INFO:tasks.ceph.mds.a:Started 2024-05-04T07:51:35.012 DEBUG:teuthology.parallel:result is None 2024-05-04T07:51:35.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-04T07:51:35.168 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2024-05-04T07:51:35.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.207+0000 7fc15e600640 1 Processor -- start 2024-05-04T07:51:35.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.207+0000 7fc15e600640 1 -- start start 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15e600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1580b3da0 0x7fc158163570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15e600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc158162c10 con 0x7fc158162830 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15e600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1580b5c40 con 0x7fc158163ab0 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15e600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc15806df60 con 0x7fc1580b3da0 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15d200640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc158162830 0x7fc158162e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36622/0 (socket says 172.21.15.136:36622) 2024-05-04T07:51:35.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.208+0000 7fc15d200640 1 -- 172.21.15.136:0/3615212573 learned_addr learned my addr 172.21.15.136:0/3615212573 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:35.211 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc14fe00640 1 --2- 172.21.15.136:0/3615212573 >> v2:172.21.15.142:3300/0 conn(0x7fc1580b3da0 0x7fc158163570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917540971 0 0) 0x7fc148001110 con 0x7fc158162830 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc13c003520 con 0x7fc158162830 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3925174913 0 0) 0x7fc13c003520 con 0x7fc158162830 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 >> v2:172.21.15.142:3300/0 conn(0x7fc1580b3da0 msgr2=0x7fc158163570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 --2- 172.21.15.136:0/3615212573 >> v2:172.21.15.142:3300/0 conn(0x7fc1580b3da0 0x7fc158163570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 >> v1:172.21.15.142:6789/0 conn(0x7fc158163ab0 legacy=0x7fc1580b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15806e240 con 0x7fc158162830 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fc1480018c0 con 0x7fc158162830 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 >> v1:172.21.15.136:6789/0 conn(0x7fc158162830 legacy=0x7fc158162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.209+0000 7fc157e00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc13c003a50 0x7fc13c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc157e00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c004800 0x7fc13c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc157e00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 0x7fc13c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc15806df60 con 0x7fc13c0052e0 2024-05-04T07:51:35.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c00c1b0 con 0x7fc13c004800 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c00c3b0 con 0x7fc13c003a50 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 0x7fc13c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc14fe00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c004800 0x7fc13c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15d200640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc13c003a50 0x7fc13c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 -- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc13c003a50 msgr2=0x7fc13c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc13c003a50 0x7fc13c003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 -- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c004800 msgr2=0x7fc13c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c004800 0x7fc13c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc15dc00640 1 -- 172.21.15.136:0/3615212573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c003520 con 0x7fc13c0052e0 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.210+0000 7fc14fe00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c004800 0x7fc13c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.211+0000 7fc15dc00640 1 -- 172.21.15.136:0/3615212573 reap_dead start 2024-05-04T07:51:35.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.211+0000 7fc15dc00640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 0x7fc13c00b9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc158072740 tx=0x7fc13c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fb6b8082b02cd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150001ab0 con 0x7fc13c0052e0 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15002adf0 con 0x7fc13c0052e0 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc157e00640 1 -- 172.21.15.136:0/3615212573 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150003b70 con 0x7fc13c0052e0 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 -- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 msgr2=0x7fc13c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 0x7fc13c00b9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc158072740 tx=0x7fc13c005830 comp rx=0 tx=0).stop 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 -- 172.21.15.136:0/3615212573 shutdown_connections 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 --2- 172.21.15.136:0/3615212573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc13c0052e0 0x7fc13c00b9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 -- 172.21.15.136:0/3615212573 >> 172.21.15.136:0/3615212573 conn(0x7fc1580d2d50 msgr2=0x7fc1580d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.212+0000 7fc15e600640 1 -- 172.21.15.136:0/3615212573 shutdown_connections 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.213+0000 7fc15e600640 1 -- 172.21.15.136:0/3615212573 wait complete. 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.214+0000 7fc15e600640 1 Processor -- start 2024-05-04T07:51:35.215 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.214+0000 7fc15e600640 1 -- start start 2024-05-04T07:51:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c0052e0 0x7fc15815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1581589f0 0x7fc1580b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc15806e800 con 0x7fc158158130 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc1580d2280 con 0x7fc13c0052e0 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc15e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc158162e60 con 0x7fc1581589f0 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.215+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59390/0 (socket says 172.21.15.136:59390) 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 -- 172.21.15.136:0/2100983604 learned_addr learned my addr 172.21.15.136:0/2100983604 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 -- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1581589f0 msgr2=0x7fc1580b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1581589f0 0x7fc1580b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 -- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c0052e0 msgr2=0x7fc15815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c0052e0 0x7fc15815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 -- 172.21.15.136:0/2100983604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc158159360 con 0x7fc158158130 2024-05-04T07:51:35.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc14fe00640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc1400108b0 tx=0x7fc140010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.216+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14000f040 con 0x7fc158158130 2024-05-04T07:51:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.217+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc14000eb00 con 0x7fc158158130 2024-05-04T07:51:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.217+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14001c400 con 0x7fc158158130 2024-05-04T07:51:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.217+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc158159640 con 0x7fc158158130 2024-05-04T07:51:35.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.217+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc158159c00 con 0x7fc158158130 2024-05-04T07:51:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.218+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc158069b10 con 0x7fc158158130 2024-05-04T07:51:35.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.219+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc14001c5a0 con 0x7fc158158130 2024-05-04T07:51:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.220+0000 7fc155600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 0x7fc1340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:35.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.220+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7fc140097b00 con 0x7fc158158130 2024-05-04T07:51:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.220+0000 7fc15d200640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 0x7fc1340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:35.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.221+0000 7fc15d200640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 0x7fc1340787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc148000f60 tx=0x7fc148009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:35.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.225+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc140018030 con 0x7fc158158130 2024-05-04T07:51:35.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:35.444+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc15806ea90 con 0x7fc158158130 2024-05-04T07:51:37.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.013+0000 7fc155600640 1 -- 172.21.15.136:0/2100983604 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7fc140061530 con 0x7fc158158130 2024-05-04T07:51:37.015 INFO:teuthology.orchestra.run.smithi136.stderr: removed all blocklist entries 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 msgr2=0x7fc1340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 0x7fc1340787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc148000f60 tx=0x7fc148009040 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 msgr2=0x7fc158157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc1400108b0 tx=0x7fc140010d70 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 shutdown_connections 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fc134076300 0x7fc1340787c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1581589f0 0x7fc1580b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc158158130 0x7fc158157a10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 --2- 172.21.15.136:0/2100983604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc13c0052e0 0x7fc15815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 >> 172.21.15.136:0/2100983604 conn(0x7fc1580d2d50 msgr2=0x7fc1580d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 shutdown_connections 2024-05-04T07:51:37.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.018+0000 7fc15e600640 1 -- 172.21.15.136:0/2100983604 wait complete. 2024-05-04T07:51:37.041 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-04T07:51:37.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.238+0000 7f9d89400640 1 Processor -- start 2024-05-04T07:51:37.239 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.238+0000 7f9d89400640 1 -- start start 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.239+0000 7f9d89400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d840cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.239+0000 7f9d89400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d840cee00 con 0x7f9d840ce8d0 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.239+0000 7f9d89400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d840cf0e0 con 0x7f9d8406f220 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.239+0000 7f9d89400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d840d1840 con 0x7f9d840afc80 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.240+0000 7f9d83400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f9d840ce8d0 0x7f9d84071d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36638/0 (socket says 172.21.15.136:36638) 2024-05-04T07:51:37.240 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.240+0000 7f9d83400640 1 -- 172.21.15.136:0/625395695 learned_addr learned my addr 172.21.15.136:0/625395695 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:37.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.240+0000 7f9d83e00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d840cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.240+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604916603 0 0) 0x7f9d840cee00 con 0x7f9d840ce8d0 2024-05-04T07:51:37.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.240+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d68003520 con 0x7f9d840ce8d0 2024-05-04T07:51:37.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3138063700 0 0) 0x7f9d68003520 con 0x7f9d840ce8d0 2024-05-04T07:51:37.242 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 msgr2=0x7f9d840cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d840cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 >> v1:172.21.15.142:6789/0 conn(0x7f9d8406f220 legacy=0x7f9d840b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d840cf3c0 con 0x7f9d840ce8d0 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f9d700016f0 con 0x7f9d840ce8d0 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 >> v1:172.21.15.136:6789/0 conn(0x7f9d840ce8d0 legacy=0x7f9d84071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d68003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d68004050 0x7f9d68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d68004d40 0x7f9d680051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6800bb80 con 0x7f9d68004d40 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6800bd30 con 0x7f9d68004050 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6800bf30 con 0x7f9d840afc80 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d88a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d68004d40 0x7f9d680051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d83e00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d68003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.243 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.241+0000 7f9d83400640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d68004050 0x7f9d68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.242+0000 7f9d88a00640 1 -- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 msgr2=0x7f9d68003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:37.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.242+0000 7f9d88a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d840afc80 0x7f9d68003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.242+0000 7f9d88a00640 1 -- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d68004050 msgr2=0x7f9d68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:37.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.242+0000 7f9d88a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d68004050 0x7f9d68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.244 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.242+0000 7f9d88a00640 1 -- 172.21.15.136:0/625395695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d68003520 con 0x7f9d68004d40 2024-05-04T07:51:37.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.243+0000 7f9d88a00640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d68004d40 0x7f9d680051a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001e90 tx=0x7f9d68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e708213a715e4987 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.243+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c001ab0 con 0x7f9d68004d40 2024-05-04T07:51:37.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.243+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d7c02ae50 con 0x7f9d68004d40 2024-05-04T07:51:37.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.243+0000 7f9d82a00640 1 -- 172.21.15.136:0/625395695 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c003b70 con 0x7f9d68004d40 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 -- 172.21.15.136:0/625395695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d68004d40 msgr2=0x7f9d680051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 --2- 172.21.15.136:0/625395695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d68004d40 0x7f9d680051a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001e90 tx=0x7f9d68005830 comp rx=0 tx=0).stop 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d88a00640 1 -- 172.21.15.136:0/625395695 reap_dead start 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 -- 172.21.15.136:0/625395695 shutdown_connections 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 -- 172.21.15.136:0/625395695 >> 172.21.15.136:0/625395695 conn(0x7f9d840d09d0 msgr2=0x7f9d840d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 -- 172.21.15.136:0/625395695 shutdown_connections 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.244+0000 7f9d89400640 1 -- 172.21.15.136:0/625395695 wait complete. 2024-05-04T07:51:37.246 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.246+0000 7f9d89400640 1 Processor -- start 2024-05-04T07:51:37.247 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.246+0000 7f9d89400640 1 -- start start 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d841eff70 0x7f9d840c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d8415f730 0x7f9d8415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840b0060 con 0x7f9d841f0350 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d840cf980 con 0x7f9d841eff70 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d89400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d840b01e0 con 0x7f9d8415f730 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.248 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59412/0 (socket says 172.21.15.136:59412) 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 -- 172.21.15.136:0/2857494304 learned_addr learned my addr 172.21.15.136:0/2857494304 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83e00640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d841eff70 0x7f9d840c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 -- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d8415f730 msgr2=0x7f9d8415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d8415f730 0x7f9d8415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 -- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d841eff70 msgr2=0x7f9d840c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d841eff70 0x7f9d840c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.247+0000 7f9d83400640 1 -- 172.21.15.136:0/2857494304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d841600d0 con 0x7f9d841f0350 2024-05-04T07:51:37.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d83400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000ea70 tx=0x7f9d7000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000c870 con 0x7f9d841f0350 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d70018070 con 0x7f9d841f0350 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7000cc50 con 0x7f9d841f0350 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d840c59c0 con 0x7f9d841f0350 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.248+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d840c5f80 con 0x7f9d841f0350 2024-05-04T07:51:37.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.249+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d84069400 con 0x7f9d841f0350 2024-05-04T07:51:37.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.250+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9d70013420 con 0x7f9d841f0350 2024-05-04T07:51:37.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.251+0000 7f9d7be00640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 0x7f9d640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.251+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9d70096fb0 con 0x7f9d841f0350 2024-05-04T07:51:37.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.252+0000 7f9d83e00640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 0x7f9d640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.252 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.252+0000 7f9d83e00640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 0x7f9d640787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d740099e0 tx=0x7f9d74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.256+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9d70060a30 con 0x7f9d841f0350 2024-05-04T07:51:37.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.538+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9d840b6470 con 0x7f9d841f0350 2024-05-04T07:51:37.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.539+0000 7f9d7be00640 1 -- 172.21.15.136:0/2857494304 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f9d70060330 con 0x7f9d841f0350 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "auth_dump": [ 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.a", 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB96DVmhzBFGhAAi/G1ikBeIqpbgG3mx7xw4Q==", 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.540 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.b", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB96DVmxHtvNxAAY+7wZItq12+lN/2kpvDHEg==", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.c", 2024-05-04T07:51:37.541 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB96DVmHr99KBAAU5SsNIpIAmGXMdPrpblJPw==", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mds.d", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB+6DVmMClxCBAAJLrfauP23EeQ0I4xTqhNuA==", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2024-05-04T07:51:37.542 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.0", 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCC6DVmBaBqCRAAZipB2PO7F9Uq/424lbor7Q==", 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.543 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.1", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCF6DVmDuYqFhAAXHmV9OdDx7S3CGTUFUoycg==", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.2", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCI6DVmr3wpMRAA8WvlS7mf6xywVPm9/8lN5A==", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.544 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.3", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCM6DVmDQNIAhAAMJbQr/ophUcqRO1/o0AO6Q==", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.4", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCS6DVmKYFFGBAAaMyQILM0gNcTjmjmeqei3w==", 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.545 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.5", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCV6DVm1+yVMRAAru8qg4gOWpFzwTMt9P+MbA==", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.6", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCZ6DVmcpvaDxAAPZ5wNkmtOH5qzE73Wj0UlA==", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "osd.7", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCc6DVm4i3AGRAAjZBrRi8M+IUtdJHhtT/axQ==", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow profile osd", 2024-05-04T07:51:37.547 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile osd", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.0", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB+6DVmlFbsFBAAIn9GcuvztIqP7lCKmms1KA==", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.1", 2024-05-04T07:51:37.548 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB+6DVm5n2TJxAAq7XBFt6ZvbDe+L2s+/0r/g==", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.2", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB+6DVmyp46HhAAJFW41LvazXR78tAHZM5w0A==", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2024-05-04T07:51:37.549 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.3", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB+6DVmq/EjMRAA1KezP1A0XAjO9mOc546eRA==", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow r", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow rw", 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow rwx" 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.550 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.admin", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB86DVmWHp8GBAAjjXrjse7hK3mShim0Guy/g==", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mgr": "allow *", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow *", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-mds", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmbtTmORAAmNg/zJCwWfWTElgw7zRHyg==", 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-mds" 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-mgr", 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmi/HmORAActD7e7Hbk27+G+HpUaT41g==", 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-osd", 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmbQrnORAATjte+ObxH9cmQM5lvx1WkA==", 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-osd" 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rbd", 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmTCTnORAAH7ha6zXi/aUfksPGiQqPPg==", 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmkj3nORAAltHDEk09GfOlKchgDhi2XA==", 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.553 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "client.bootstrap-rgw", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQCp6DVmA1fnORAAMeWVuxCRJQh8ajDA3wygvw==", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mgr.x", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB96DVmBo7gDxAA1F6P45Zru000fSG4YE7Kgw==", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile mgr", 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-04T07:51:37.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "entity": "mgr.y", 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "key": "AQB96DVmuHncBxAAqi/WJT31GsWiRQJKaD6cew==", 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": { 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": "allow *", 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "mon": "allow profile mgr", 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: "osd": "allow *" 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-05-04T07:51:37.555 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 msgr2=0x7f9d640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 0x7f9d640787c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d740099e0 tx=0x7f9d74008040 comp rx=0 tx=0).stop 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 msgr2=0x7f9d841f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000ea70 tx=0x7f9d7000ef30 comp rx=0 tx=0).stop 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 shutdown_connections 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9d64076300 0x7f9d640787c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d8415f730 0x7f9d8415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.556 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d841f0350 0x7f9d841f3700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 --2- 172.21.15.136:0/2857494304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d841eff70 0x7f9d840c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 >> 172.21.15.136:0/2857494304 conn(0x7f9d840d09d0 msgr2=0x7f9d8406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:37.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 shutdown_connections 2024-05-04T07:51:37.557 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.542+0000 7f9d89400640 1 -- 172.21.15.136:0/2857494304 wait complete. 2024-05-04T07:51:37.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-04T07:51:37.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.762+0000 7fa5e7e00640 1 Processor -- start 2024-05-04T07:51:37.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.762+0000 7fa5e7e00640 1 -- start start 2024-05-04T07:51:37.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.763+0000 7fa5e7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa5e80cc580 0x7fa5e80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.763+0000 7fa5e7e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5e815f870 0x7fa5e815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.763+0000 7fa5e7e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e80ce830 con 0x7fa5e8159aa0 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.763+0000 7fa5e7e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e80ce5e0 con 0x7fa5e80cc580 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.763+0000 7fa5e7e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e80ceb10 con 0x7fa5e815f870 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa5e80cc580 0x7fa5e80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa5e80cc580 0x7fa5e80cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59414/0 (socket says 172.21.15.136:59414) 2024-05-04T07:51:37.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 -- 172.21.15.136:0/3698716349 learned_addr learned my addr 172.21.15.136:0/3698716349 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:37.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5e7400640 1 --2- 172.21.15.136:0/3698716349 >> v2:172.21.15.142:3300/0 conn(0x7fa5e815f870 0x7fa5e815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 -- 172.21.15.136:0/3698716349 >> v2:172.21.15.142:3300/0 conn(0x7fa5e815f870 msgr2=0x7fa5e815fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:37.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 --2- 172.21.15.136:0/3698716349 >> v2:172.21.15.142:3300/0 conn(0x7fa5e815f870 0x7fa5e815fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 -- 172.21.15.136:0/3698716349 >> v1:172.21.15.142:6789/0 conn(0x7fa5e8159aa0 legacy=0x7fa5e806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:37.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.764+0000 7fa5dfe00640 1 -- 172.21.15.136:0/3698716349 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e80cedf0 con 0x7fa5e80cc580 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.765+0000 7fa5dfe00640 1 --2- 172.21.15.136:0/3698716349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e80cc9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80c7850 tx=0x7fa5d002c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81e16ab1e4ed87a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e6000640 1 -- 172.21.15.136:0/3698716349 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0032700 con 0x7fa5e80cc580 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e6000640 1 -- 172.21.15.136:0/3698716349 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d00328a0 con 0x7fa5e80cc580 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e6000640 1 -- 172.21.15.136:0/3698716349 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0032c70 con 0x7fa5e80cc580 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e7e00640 1 -- 172.21.15.136:0/3698716349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 msgr2=0x7fa5e80cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/3698716349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e80cc9c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80c7850 tx=0x7fa5d002c800 comp rx=0 tx=0).stop 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e7e00640 1 -- 172.21.15.136:0/3698716349 shutdown_connections 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/3698716349 >> v2:172.21.15.142:3300/0 conn(0x7fa5e815f870 0x7fa5e815fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.766+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/3698716349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e80cc9c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.767+0000 7fa5e7e00640 1 -- 172.21.15.136:0/3698716349 >> 172.21.15.136:0/3698716349 conn(0x7fa5e80cd490 msgr2=0x7fa5e80cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.767+0000 7fa5e7e00640 1 -- 172.21.15.136:0/3698716349 shutdown_connections 2024-05-04T07:51:37.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.767+0000 7fa5e7e00640 1 -- 172.21.15.136:0/3698716349 wait complete. 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.768+0000 7fa5e7e00640 1 Processor -- start 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 -- start start 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e8159aa0 0x7fa5e8158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e815f870 0x7fa5e815adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e8160530 con 0x7fa5e80cc580 2024-05-04T07:51:37.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e806e1e0 con 0x7fa5e815f870 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.769+0000 7fa5e7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e81606b0 con 0x7fa5e8159aa0 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59426/0 (socket says 172.21.15.136:59426) 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 -- 172.21.15.136:0/1131548009 learned_addr learned my addr 172.21.15.136:0/1131548009 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5dfe00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e8159aa0 0x7fa5e8158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 -- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e8159aa0 msgr2=0x7fa5e8158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e8159aa0 0x7fa5e8158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 -- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e815f870 msgr2=0x7fa5e815adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e815f870 0x7fa5e815adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 -- 172.21.15.136:0/1131548009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e8158fc0 con 0x7fa5e80cc580 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.770+0000 7fa5e6a00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b410 tx=0x7fa5d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.771+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8015020 con 0x7fa5e80cc580 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.771+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d8011830 con 0x7fa5e80cc580 2024-05-04T07:51:37.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.771+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8011c20 con 0x7fa5e80cc580 2024-05-04T07:51:37.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.771+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e81592a0 con 0x7fa5e80cc580 2024-05-04T07:51:37.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.771+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e8072270 con 0x7fa5e80cc580 2024-05-04T07:51:37.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.772+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e8069400 con 0x7fa5e80cc580 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.773+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa5d8018020 con 0x7fa5e80cc580 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.774+0000 7fa5dea00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 0x7fa5c40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.774+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa5d8096e40 con 0x7fa5e80cc580 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.775+0000 7fa5dfe00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 0x7fa5c40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.776+0000 7fa5dfe00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 0x7fa5c40787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0037000 tx=0x7fa5d0036040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:37.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:37.778+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa5d801f070 con 0x7fa5e80cc580 2024-05-04T07:51:38.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.062+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fa5e806e7e0 con 0x7fa5e80cc580 2024-05-04T07:51:38.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.066+0000 7fa5dea00640 1 -- 172.21.15.136:0/1131548009 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fa5d8060960 con 0x7fa5e80cc580 2024-05-04T07:51:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.068+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 msgr2=0x7fa5c40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.068+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 0x7fa5c40787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0037000 tx=0x7fa5d0036040 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.068+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 msgr2=0x7fa5e81515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.068+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800b410 tx=0x7fa5d800b8d0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 shutdown_connections 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa5c4076300 0x7fa5c40787c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e815f870 0x7fa5e815adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e8159aa0 0x7fa5e8158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 --2- 172.21.15.136:0/1131548009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e80cc580 0x7fa5e81515d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 >> 172.21.15.136:0/1131548009 conn(0x7fa5e80cd490 msgr2=0x7fa5e80cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 shutdown_connections 2024-05-04T07:51:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.069+0000 7fa5e7e00640 1 -- 172.21.15.136:0/1131548009 wait complete. 2024-05-04T07:51:38.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-04T07:51:38.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.280+0000 7f9fb9200640 1 Processor -- start 2024-05-04T07:51:38.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.280+0000 7f9fb9200640 1 -- start start 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9fb4162720 0x7f9fb40d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 0x7f9fb406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb4073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb40d19e0 con 0x7f9fb4162720 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb40cfb30 con 0x7f9fb40cceb0 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb9200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb4162b00 con 0x7f9fb406c8e0 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.281+0000 7f9fb1e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9fb4162720 0x7f9fb40d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9fb4162720 0x7f9fb40d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59440/0 (socket says 172.21.15.136:59440) 2024-05-04T07:51:38.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 -- 172.21.15.136:0/546717961 learned_addr learned my addr 172.21.15.136:0/546717961 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:38.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 -- 172.21.15.136:0/546717961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 msgr2=0x7f9fb4073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:38.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb2800640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb4073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1400640 1 --2- 172.21.15.136:0/546717961 >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 0x7f9fb406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb4073000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 -- 172.21.15.136:0/546717961 >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 msgr2=0x7f9fb406c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/546717961 >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 0x7f9fb406c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1e00640 1 -- 172.21.15.136:0/546717961 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb40cfd80 con 0x7f9fb4162720 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.282+0000 7f9fb1400640 1 --2- 172.21.15.136:0/546717961 >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 0x7f9fb406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:38.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.283+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb4162720 0x7f9fb40d14a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40689a0 tx=0x7f9f9c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e485103226efc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.283+0000 7f9fb0a00640 1 -- 172.21.15.136:0/546717961 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c037070 con 0x7f9fb4162720 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb0a00640 1 -- 172.21.15.136:0/546717961 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f9c032440 con 0x7f9fb4162720 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb0a00640 1 -- 172.21.15.136:0/546717961 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c032810 con 0x7f9fb4162720 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 -- 172.21.15.136:0/546717961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb4162720 msgr2=0x7f9fb40d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb4162720 0x7f9fb40d14a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40689a0 tx=0x7f9f9c02a140 comp rx=0 tx=0).stop 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 -- 172.21.15.136:0/546717961 shutdown_connections 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb4073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 --2- 172.21.15.136:0/546717961 >> v2:172.21.15.142:3300/0 conn(0x7f9fb40cceb0 0x7f9fb406c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 --2- 172.21.15.136:0/546717961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb4162720 0x7f9fb40d14a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 -- 172.21.15.136:0/546717961 >> 172.21.15.136:0/546717961 conn(0x7f9fb40d1cc0 msgr2=0x7f9fb40d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 -- 172.21.15.136:0/546717961 shutdown_connections 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.284+0000 7f9fb9200640 1 -- 172.21.15.136:0/546717961 wait complete. 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.286+0000 7f9fb9200640 1 Processor -- start 2024-05-04T07:51:38.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.286+0000 7f9fb9200640 1 -- start start 2024-05-04T07:51:38.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 0x7f9fb40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40d0620 con 0x7f9fb40cceb0 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40d0340 con 0x7f9fb4162720 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb9200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb40d0900 con 0x7f9fb406c8e0 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb1400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb1400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59454/0 (socket says 172.21.15.136:59454) 2024-05-04T07:51:38.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.287+0000 7f9fb1400640 1 -- 172.21.15.136:0/677770090 learned_addr learned my addr 172.21.15.136:0/677770090 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:38.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb2800640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 0x7f9fb40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 -- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 msgr2=0x7f9fb414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb414ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 -- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 msgr2=0x7f9fb40700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 0x7f9fb40700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 -- 172.21.15.136:0/677770090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb40b7090 con 0x7f9fb40cceb0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb2800640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 0x7f9fb40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb1400640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400ce00 tx=0x7f9fa400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400f890 con 0x7f9fb40cceb0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa400fa30 con 0x7f9fb40cceb0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400fe40 con 0x7f9fb40cceb0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.288+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb40b7610 con 0x7f9fb40cceb0 2024-05-04T07:51:38.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.289+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb40b7330 con 0x7f9fb40cceb0 2024-05-04T07:51:38.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.290+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4069b10 con 0x7f9fb40cceb0 2024-05-04T07:51:38.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.291+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9fa4018400 con 0x7f9fb40cceb0 2024-05-04T07:51:38.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.292+0000 7f9faa000640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 0x7f9f90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.292+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9fa4098140 con 0x7f9fb40cceb0 2024-05-04T07:51:38.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.292+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 0x7f9f90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.293+0000 7f9fb1e00640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 0x7f9f90078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c034000 tx=0x7f9f9c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.296+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9fa4014030 con 0x7f9fb40cceb0 2024-05-04T07:51:38.572 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.571+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f9fb40ccb50 con 0x7f9fb40cceb0 2024-05-04T07:51:38.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.575+0000 7f9faa000640 1 -- 172.21.15.136:0/677770090 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f9fa400ae20 con 0x7f9fb40cceb0 2024-05-04T07:51:38.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.577+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 msgr2=0x7f9f90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.577+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 0x7f9f90078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c034000 tx=0x7f9f9c02e000 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 msgr2=0x7f9fb414d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400ce00 tx=0x7f9fa400a650 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 shutdown_connections 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9f900762d0 0x7f9f90078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb4162720 0x7f9fb40700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fb40cceb0 0x7f9fb414d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 --2- 172.21.15.136:0/677770090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb406c8e0 0x7f9fb414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 >> 172.21.15.136:0/677770090 conn(0x7f9fb40d1cc0 msgr2=0x7f9fb4072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 shutdown_connections 2024-05-04T07:51:38.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.578+0000 7f9fb9200640 1 -- 172.21.15.136:0/677770090 wait complete. 2024-05-04T07:51:38.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-04T07:51:38.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.798+0000 7f86f7400640 1 Processor -- start 2024-05-04T07:51:38.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.799+0000 7f86f7400640 1 -- start start 2024-05-04T07:51:38.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f7400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00b5540 0x7f86f00d3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00d0cf0 0x7f86f00d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f7400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f0162f10 con 0x7f86f00d2130 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f7400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f86f00b63c0 con 0x7f86f00b5540 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f7400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00b5920 con 0x7f86f00d0cf0 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f4a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00b5540 0x7f86f00d3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86efe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f86f00d2130 0x7f86f00c8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36644/0 (socket says 172.21.15.136:36644) 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86efe00640 1 -- 172.21.15.136:0/2828123888 learned_addr learned my addr 172.21.15.136:0/2828123888 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f4a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00b5540 0x7f86f00d3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59460/0 (socket says 172.21.15.136:59460) 2024-05-04T07:51:38.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.801+0000 7f86f5400640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00d0cf0 0x7f86f00d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.802+0000 7f86f4a00640 1 -- 172.21.15.136:0/2828123888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00d0cf0 msgr2=0x7f86f00d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:38.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.802+0000 7f86f4a00640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00d0cf0 0x7f86f00d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.802+0000 7f86f4a00640 1 -- 172.21.15.136:0/2828123888 >> v1:172.21.15.136:6789/0 conn(0x7f86f00d2130 legacy=0x7f86f00c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.802+0000 7f86f4a00640 1 -- 172.21.15.136:0/2828123888 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00b5c90 con 0x7f86f00b5540 2024-05-04T07:51:38.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86f4a00640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00b5540 0x7f86f00d3640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009d90 tx=0x7f86e002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9f7f7f6e5cefa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86ef400640 1 -- 172.21.15.136:0/2828123888 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0031600 con 0x7f86f00b5540 2024-05-04T07:51:38.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86ef400640 1 -- 172.21.15.136:0/2828123888 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e00317a0 con 0x7f86f00b5540 2024-05-04T07:51:38.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86ef400640 1 -- 172.21.15.136:0/2828123888 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0031b70 con 0x7f86f00b5540 2024-05-04T07:51:38.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86f7400640 1 -- 172.21.15.136:0/2828123888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00b5540 msgr2=0x7f86f00d3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.803+0000 7f86f7400640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00b5540 0x7f86f00d3640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009d90 tx=0x7f86e002a5d0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 -- 172.21.15.136:0/2828123888 shutdown_connections 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00d0cf0 0x7f86f00d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 --2- 172.21.15.136:0/2828123888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00b5540 0x7f86f00d3640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 -- 172.21.15.136:0/2828123888 >> 172.21.15.136:0/2828123888 conn(0x7f86f00d5060 msgr2=0x7f86f00d5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 -- 172.21.15.136:0/2828123888 shutdown_connections 2024-05-04T07:51:38.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.804+0000 7f86f7400640 1 -- 172.21.15.136:0/2828123888 wait complete. 2024-05-04T07:51:38.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.805+0000 7f86f7400640 1 Processor -- start 2024-05-04T07:51:38.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 -- start start 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00b5540 0x7f86f00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f00d0cf0 0x7f86f014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00b60b0 con 0x7f86f00d2130 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00d5f20 con 0x7f86f00d0cf0 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.806+0000 7f86f7400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00c92c0 con 0x7f86f00b5540 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59466/0 (socket says 172.21.15.136:59466) 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 -- 172.21.15.136:0/3450974389 learned_addr learned my addr 172.21.15.136:0/3450974389 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 -- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00b5540 msgr2=0x7f86f00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00b5540 0x7f86f00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 -- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f00d0cf0 msgr2=0x7f86f014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f00d0cf0 0x7f86f014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:38.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.807+0000 7f86f5400640 1 -- 172.21.15.136:0/3450974389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00cc1d0 con 0x7f86f00d2130 2024-05-04T07:51:38.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86f5400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86e800d800 tx=0x7f86e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e800b6c0 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e8019070 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e800bac0 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f00cc4b0 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.808+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f00cca70 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.809+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0069470 con 0x7f86f00d2130 2024-05-04T07:51:38.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.810+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f86e800bc60 con 0x7f86f00d2130 2024-05-04T07:51:38.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.811+0000 7f86ecc00640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 0x7f86cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:38.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.811+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f86e80978e0 con 0x7f86f00d2130 2024-05-04T07:51:38.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.811+0000 7f86f4a00640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 0x7f86cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:38.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.812+0000 7f86f4a00640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 0x7f86cc0787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e0034000 tx=0x7f86e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:38.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:38.816+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86e80613f0 con 0x7f86f00d2130 2024-05-04T07:51:39.090 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.089+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f86f0069d20 con 0x7f86f00d2130 2024-05-04T07:51:39.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.093+0000 7f86ecc00640 1 -- 172.21.15.136:0/3450974389 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f86e8060cf0 con 0x7f86f00d2130 2024-05-04T07:51:39.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 msgr2=0x7f86cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 0x7f86cc0787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86e0034000 tx=0x7f86e002e000 comp rx=0 tx=0).stop 2024-05-04T07:51:39.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 msgr2=0x7f86f00ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f86e800d800 tx=0x7f86e800dcc0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 shutdown_connections 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f86cc076300 0x7f86cc0787c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00d2130 0x7f86f00ca020 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86f00d0cf0 0x7f86f014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 --2- 172.21.15.136:0/3450974389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86f00b5540 0x7f86f00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 >> 172.21.15.136:0/3450974389 conn(0x7f86f00d5060 msgr2=0x7f86f00b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 shutdown_connections 2024-05-04T07:51:39.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.096+0000 7f86f7400640 1 -- 172.21.15.136:0/3450974389 wait complete. 2024-05-04T07:51:39.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-04T07:51:39.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.306+0000 7f93aa400640 1 Processor -- start 2024-05-04T07:51:39.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.306+0000 7f93aa400640 1 -- start start 2024-05-04T07:51:39.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.308+0000 7f93aa400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a40d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.308+0000 7f93aa400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93a40b92a0 0x7f93a40b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.308+0000 7f93aa400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a40d5e00 con 0x7f93a40cfa70 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.308+0000 7f93aa400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f93a40b8850 con 0x7f93a40b92a0 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.308+0000 7f93aa400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93a40d0a10 con 0x7f93a415f0e0 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93a40b92a0 0x7f93a40b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93a40b92a0 0x7f93a40b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:57498/0 (socket says 172.21.15.136:57498) 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a40d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 -- 172.21.15.136:0/2750456066 learned_addr learned my addr 172.21.15.136:0/2750456066 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:39.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 -- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 msgr2=0x7f93a40d58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:39.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 --2- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a40d58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 -- 172.21.15.136:0/2750456066 >> v1:172.21.15.142:6789/0 conn(0x7f93a40cfa70 legacy=0x7f93a40cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.309+0000 7f93a9a00640 1 -- 172.21.15.136:0/2750456066 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a40d0cf0 con 0x7f93a40b92a0 2024-05-04T07:51:39.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.310+0000 7f93a9a00640 1 --2- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a40b9710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f939c009e50 tx=0x7f939c02a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69fe2955b2d6c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.311+0000 7f93a3e00640 1 -- 172.21.15.136:0/2750456066 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c036070 con 0x7f93a40b92a0 2024-05-04T07:51:39.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.311+0000 7f93a3e00640 1 -- 172.21.15.136:0/2750456066 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c031600 con 0x7f93a40b92a0 2024-05-04T07:51:39.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.311+0000 7f93a3e00640 1 -- 172.21.15.136:0/2750456066 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0319d0 con 0x7f93a40b92a0 2024-05-04T07:51:39.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 -- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 msgr2=0x7f93a40b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 --2- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a40b9710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f939c009e50 tx=0x7f939c02a7a0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 -- 172.21.15.136:0/2750456066 shutdown_connections 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 --2- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a40b9710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 --2- 172.21.15.136:0/2750456066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a40d58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 -- 172.21.15.136:0/2750456066 >> 172.21.15.136:0/2750456066 conn(0x7f93a409e380 msgr2=0x7f93a40d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 -- 172.21.15.136:0/2750456066 shutdown_connections 2024-05-04T07:51:39.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.312+0000 7f93aa400640 1 -- 172.21.15.136:0/2750456066 wait complete. 2024-05-04T07:51:39.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.314+0000 7f93aa400640 1 Processor -- start 2024-05-04T07:51:39.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.314+0000 7f93aa400640 1 -- start start 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a41f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a4161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93a415f4c0 con 0x7f93a40cfa70 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f93a40b8d80 con 0x7f93a40b92a0 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f93aa400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f93a40d3d40 con 0x7f93a415f0e0 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f939be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f939be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59480/0 (socket says 172.21.15.136:59480) 2024-05-04T07:51:39.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.315+0000 7f939be00640 1 -- 172.21.15.136:0/3053728049 learned_addr learned my addr 172.21.15.136:0/3053728049 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93a9000640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a41f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93a9a00640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a4161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 -- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 msgr2=0x7f93a4161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a4161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 -- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 msgr2=0x7f93a41f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a41f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 -- 172.21.15.136:0/3053728049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a4160ec0 con 0x7f93a40cfa70 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f939be00640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c450 tx=0x7f938c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c017070 con 0x7f93a40cfa70 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0052d0 con 0x7f93a40cfa70 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a41611a0 con 0x7f93a40cfa70 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.316+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c003830 con 0x7f93a40cfa70 2024-05-04T07:51:39.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.317+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a4161a40 con 0x7f93a40cfa70 2024-05-04T07:51:39.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.318+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a4069400 con 0x7f93a40cfa70 2024-05-04T07:51:39.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.319+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f938c01a070 con 0x7f93a40cfa70 2024-05-04T07:51:39.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.320+0000 7f93a1600640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 0x7f93800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.320+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f938c096860 con 0x7f93a40cfa70 2024-05-04T07:51:39.320 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.320+0000 7f93a9000640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 0x7f93800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.321 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.321+0000 7f93a9000640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 0x7f93800787c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9394009970 tx=0x7f9394008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.325+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f938c0602f0 con 0x7f93a40cfa70 2024-05-04T07:51:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.604+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f93a40cb7a0 con 0x7f93a40cfa70 2024-05-04T07:51:39.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.609+0000 7f93a1600640 1 -- 172.21.15.136:0/3053728049 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f938c0682e0 con 0x7f93a40cfa70 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 msgr2=0x7f93800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 0x7f93800787c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9394009970 tx=0x7f9394008040 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 msgr2=0x7f93a415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c450 tx=0x7f938c00c910 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 shutdown_connections 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9380076300 0x7f93800787c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93a415f0e0 0x7f93a4161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93a40cfa70 0x7f93a415f640 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 --2- 172.21.15.136:0/3053728049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93a40b92a0 0x7f93a41f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 >> 172.21.15.136:0/3053728049 conn(0x7f93a409e380 msgr2=0x7f93a406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.612+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 shutdown_connections 2024-05-04T07:51:39.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.613+0000 7f93aa400640 1 -- 172.21.15.136:0/3053728049 wait complete. 2024-05-04T07:51:39.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-04T07:51:39.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.847+0000 7fbaf8600640 1 Processor -- start 2024-05-04T07:51:39.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.848+0000 7fbaf8600640 1 -- start start 2024-05-04T07:51:39.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 0x7fbaf00cc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 0x7fbaf006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbaf006fb30 0x7fbaf015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf006ff80 con 0x7fbaf006fb30 2024-05-04T07:51:39.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf0073760 con 0x7fbaf00cc860 2024-05-04T07:51:39.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf8600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf0073a40 con 0x7fbaf015bde0 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf6600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbaf006fb30 0x7fbaf015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf6600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbaf006fb30 0x7fbaf015fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59490/0 (socket says 172.21.15.136:59490) 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.849+0000 7fbaf6600640 1 -- 172.21.15.136:0/3142342348 learned_addr learned my addr 172.21.15.136:0/3142342348 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 0x7fbaf00cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf5200640 1 --2- 172.21.15.136:0/3142342348 >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 0x7fbaf006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf6600640 1 -- 172.21.15.136:0/3142342348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 msgr2=0x7fbaf00cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf6600640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 0x7fbaf00cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf6600640 1 -- 172.21.15.136:0/3142342348 >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 msgr2=0x7fbaf006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf6600640 1 --2- 172.21.15.136:0/3142342348 >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 0x7fbaf006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf6600640 1 -- 172.21.15.136:0/3142342348 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf0073d20 con 0x7fbaf006fb30 2024-05-04T07:51:39.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 0x7fbaf00cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:39.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.850+0000 7fbaf5200640 1 --2- 172.21.15.136:0/3142342348 >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 0x7fbaf006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:39.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.851+0000 7fbaf6600640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf006fb30 0x7fbaf015fa20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00d1d50 tx=0x7fbae802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3119cfc266c74b63 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.852+0000 7fbaefe00640 1 -- 172.21.15.136:0/3142342348 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae800b2e0 con 0x7fbaf006fb30 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.852+0000 7fbaefe00640 1 -- 172.21.15.136:0/3142342348 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8009600 con 0x7fbaf006fb30 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.852+0000 7fbaefe00640 1 -- 172.21.15.136:0/3142342348 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae800b480 con 0x7fbaf006fb30 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.852+0000 7fbaf8600640 1 -- 172.21.15.136:0/3142342348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf006fb30 msgr2=0x7fbaf015fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.852+0000 7fbaf8600640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf006fb30 0x7fbaf015fa20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00d1d50 tx=0x7fbae802c8a0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 -- 172.21.15.136:0/3142342348 shutdown_connections 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf006fb30 0x7fbaf015fa20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 --2- 172.21.15.136:0/3142342348 >> v2:172.21.15.142:3300/0 conn(0x7fbaf00cc860 0x7fbaf006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 --2- 172.21.15.136:0/3142342348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf015bde0 0x7fbaf00cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 -- 172.21.15.136:0/3142342348 >> 172.21.15.136:0/3142342348 conn(0x7fbaf00d0c50 msgr2=0x7fbaf00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 -- 172.21.15.136:0/3142342348 shutdown_connections 2024-05-04T07:51:39.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.853+0000 7fbaf8600640 1 -- 172.21.15.136:0/3142342348 wait complete. 2024-05-04T07:51:39.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.854+0000 7fbaf8600640 1 Processor -- start 2024-05-04T07:51:39.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.854+0000 7fbaf8600640 1 -- start start 2024-05-04T07:51:39.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 0x7fbaf015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 0x7fbaf015de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0073390 con 0x7fbaf015bde0 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf015c1c0 con 0x7fbaf006fb30 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.855+0000 7fbaf8600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf0073510 con 0x7fbaf00cc860 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59494/0 (socket says 172.21.15.136:59494) 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 -- 172.21.15.136:0/2759980222 learned_addr learned my addr 172.21.15.136:0/2759980222 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf5200640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 0x7fbaf015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 0x7fbaf015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 -- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 msgr2=0x7fbaf015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 0x7fbaf015de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 -- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 msgr2=0x7fbaf015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:39.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 0x7fbaf015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:39.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf6600640 1 -- 172.21.15.136:0/2759980222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf00c8050 con 0x7fbaf015bde0 2024-05-04T07:51:39.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 0x7fbaf015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:39.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.856+0000 7fbaf5200640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 0x7fbaf015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaf6600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d240 tx=0x7fbae8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8041030 con 0x7fbaf015bde0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae803d650 con 0x7fbaf015bde0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae803da40 con 0x7fbaf015bde0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf00c8330 con 0x7fbaf015bde0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.857+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf00c88f0 con 0x7fbaf015bde0 2024-05-04T07:51:39.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.858+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf0069470 con 0x7fbaf015bde0 2024-05-04T07:51:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.859+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbae803b040 con 0x7fbaf015bde0 2024-05-04T07:51:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.860+0000 7fbaed600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 0x7fbad0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.860+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbae8030020 con 0x7fbaf015bde0 2024-05-04T07:51:39.863 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.860+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 0x7fbad0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:39.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.861+0000 7fbaf5c00640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 0x7fbad0078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbaf015ede0 tx=0x7fbae4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:39.865 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:39.865+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbae804b070 con 0x7fbaf015bde0 2024-05-04T07:51:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.143+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbaf006de90 con 0x7fbaf015bde0 2024-05-04T07:51:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.148+0000 7fbaed600640 1 -- 172.21.15.136:0/2759980222 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7fbae80838b0 con 0x7fbaf015bde0 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 msgr2=0x7fbad0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 0x7fbad0078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbaf015ede0 tx=0x7fbae4008040 comp rx=0 tx=0).stop 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 msgr2=0x7fbaf015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbae800d240 tx=0x7fbae8004a40 comp rx=0 tx=0).stop 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 shutdown_connections 2024-05-04T07:51:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.150+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fbad00762d0 0x7fbad0078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbaf015bde0 0x7fbaf015c860 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbaf00cc860 0x7fbaf015de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 --2- 172.21.15.136:0/2759980222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbaf006fb30 0x7fbaf015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 >> 172.21.15.136:0/2759980222 conn(0x7fbaf00d0c50 msgr2=0x7fbaf00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 shutdown_connections 2024-05-04T07:51:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.151+0000 7fbaf8600640 1 -- 172.21.15.136:0/2759980222 wait complete. 2024-05-04T07:51:40.168 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-04T07:51:40.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-04T07:51:40.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.353+0000 7f8a44a00640 1 Processor -- start 2024-05-04T07:51:40.354 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.353+0000 7f8a44a00640 1 -- start start 2024-05-04T07:51:40.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a44a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a400cb340 0x7f8a400c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a44a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a400ccfa0 con 0x7f8a400ce5e0 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a44a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a400d0460 con 0x7f8a40145ad0 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a44a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8a40145eb0 con 0x7f8a400cb340 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a37e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a400cb340 0x7f8a400c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a37e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a400cb340 0x7f8a400c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59500/0 (socket says 172.21.15.136:59500) 2024-05-04T07:51:40.356 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.355+0000 7f8a37e00640 1 -- 172.21.15.136:0/1563806508 learned_addr learned my addr 172.21.15.136:0/1563806508 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.356+0000 7f8a37e00640 1 -- 172.21.15.136:0/1563806508 >> v1:172.21.15.142:6789/0 conn(0x7f8a40145ad0 legacy=0x7f8a400c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.356+0000 7f8a37e00640 1 -- 172.21.15.136:0/1563806508 >> v1:172.21.15.136:6789/0 conn(0x7f8a400ce5e0 legacy=0x7f8a400cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.356+0000 7f8a37e00640 1 -- 172.21.15.136:0/1563806508 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a400d07d0 con 0x7f8a400cb340 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a37e00640 1 --2- 172.21.15.136:0/1563806508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a400cb340 0x7f8a400c69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009870 tx=0x7f8a2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507de0e32e7883c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a3de00640 1 -- 172.21.15.136:0/1563806508 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037070 con 0x7f8a400cb340 2024-05-04T07:51:40.357 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a3de00640 1 -- 172.21.15.136:0/1563806508 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28032440 con 0x7f8a400cb340 2024-05-04T07:51:40.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a3de00640 1 -- 172.21.15.136:0/1563806508 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28032810 con 0x7f8a400cb340 2024-05-04T07:51:40.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a44a00640 1 -- 172.21.15.136:0/1563806508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a400cb340 msgr2=0x7f8a400c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.358 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.357+0000 7f8a44a00640 1 --2- 172.21.15.136:0/1563806508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a400cb340 0x7f8a400c69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009870 tx=0x7f8a2802a270 comp rx=0 tx=0).stop 2024-05-04T07:51:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.358+0000 7f8a44a00640 1 -- 172.21.15.136:0/1563806508 shutdown_connections 2024-05-04T07:51:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.358+0000 7f8a44a00640 1 --2- 172.21.15.136:0/1563806508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a400cb340 0x7f8a400c69f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.358+0000 7f8a44a00640 1 -- 172.21.15.136:0/1563806508 >> 172.21.15.136:0/1563806508 conn(0x7f8a400cd490 msgr2=0x7f8a400cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.358+0000 7f8a44a00640 1 -- 172.21.15.136:0/1563806508 shutdown_connections 2024-05-04T07:51:40.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.358+0000 7f8a44a00640 1 -- 172.21.15.136:0/1563806508 wait complete. 2024-05-04T07:51:40.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.359+0000 7f8a44a00640 1 Processor -- start 2024-05-04T07:51:40.360 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.359+0000 7f8a44a00640 1 -- start start 2024-05-04T07:51:40.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a400cb340 0x7f8a401f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a400ce5e0 0x7f8a40142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a400ccbc0 con 0x7f8a40145ad0 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a400cd280 con 0x7f8a400ce5e0 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a44a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8a400ccd40 con 0x7f8a400cb340 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a3f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a3f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59502/0 (socket says 172.21.15.136:59502) 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.360+0000 7f8a3f200640 1 -- 172.21.15.136:0/3280457173 learned_addr learned my addr 172.21.15.136:0/3280457173 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 -- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a400cb340 msgr2=0x7f8a401f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a400cb340 0x7f8a401f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 -- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a400ce5e0 msgr2=0x7f8a40142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a400ce5e0 0x7f8a40142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 -- 172.21.15.136:0/3280457173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a401e7010 con 0x7f8a40145ad0 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a3f200640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c760 tx=0x7f8a3800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003b70 con 0x7f8a40145ad0 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38003d10 con 0x7f8a40145ad0 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800aa70 con 0x7f8a40145ad0 2024-05-04T07:51:40.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.361+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a401e72f0 con 0x7f8a40145ad0 2024-05-04T07:51:40.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.362+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401e78b0 con 0x7f8a40145ad0 2024-05-04T07:51:40.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.363+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a40069400 con 0x7f8a40145ad0 2024-05-04T07:51:40.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.364+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8a3800ac10 con 0x7f8a40145ad0 2024-05-04T07:51:40.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.365+0000 7f8a36a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 0x7f8a1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.365+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f8a38097210 con 0x7f8a40145ad0 2024-05-04T07:51:40.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.365+0000 7f8a3e800640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 0x7f8a1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.366+0000 7f8a3e800640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 0x7f8a1c0787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006fd0 tx=0x7f8a30006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.369+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8a38060dc0 con 0x7f8a40145ad0 2024-05-04T07:51:40.629 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.628+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f8a400ce2c0 con 0x7f8a40145ad0 2024-05-04T07:51:40.633 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.633+0000 7f8a36a00640 1 -- 172.21.15.136:0/3280457173 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f8a380606c0 con 0x7f8a40145ad0 2024-05-04T07:51:40.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 msgr2=0x7f8a1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 0x7f8a1c0787c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006fd0 tx=0x7f8a30006bc0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 msgr2=0x7f8a401e67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800c760 tx=0x7f8a3800cc20 comp rx=0 tx=0).stop 2024-05-04T07:51:40.636 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 shutdown_connections 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f8a1c076300 0x7f8a1c0787c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a40145ad0 0x7f8a401e67c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a400ce5e0 0x7f8a40142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 --2- 172.21.15.136:0/3280457173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a400cb340 0x7f8a401f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 >> 172.21.15.136:0/3280457173 conn(0x7f8a400cd490 msgr2=0x7f8a4015c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 shutdown_connections 2024-05-04T07:51:40.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.636+0000 7f8a44a00640 1 -- 172.21.15.136:0/3280457173 wait complete. 2024-05-04T07:51:40.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-04T07:51:40.848 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.848+0000 7f6b0da00640 1 Processor -- start 2024-05-04T07:51:40.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.848+0000 7f6b0da00640 1 -- start start 2024-05-04T07:51:40.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.849+0000 7f6b0da00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6b0813ff40 0x7f6b08145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.849+0000 7f6b0da00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b081463a0 0x7f6b08071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b0da00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b08146900 con 0x7f6b08072430 2024-05-04T07:51:40.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b0da00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6b08140320 con 0x7f6b0813ff40 2024-05-04T07:51:40.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b0da00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0815de40 con 0x7f6b081463a0 2024-05-04T07:51:40.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b07400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6b08072430 0x7f6b08142640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36660/0 (socket says 172.21.15.136:36660) 2024-05-04T07:51:40.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b07400640 1 -- 172.21.15.136:0/2247017513 learned_addr learned my addr 172.21.15.136:0/2247017513 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:40.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2247017513 >> v2:172.21.15.136:3300/0 conn(0x7f6b0813ff40 0x7f6b08145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6affe00640 1 --2- 172.21.15.136:0/2247017513 >> v2:172.21.15.142:3300/0 conn(0x7f6b081463a0 0x7f6b08071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b06000640 1 -- 172.21.15.136:0/2247017513 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774712749 0 0) 0x7f6b08146900 con 0x7f6b08072430 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.850+0000 7f6b06000640 1 -- 172.21.15.136:0/2247017513 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aec003520 con 0x7f6b08072430 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.851+0000 7f6b06a00640 1 -- 172.21.15.136:0/2247017513 >> v2:172.21.15.142:3300/0 conn(0x7f6b081463a0 msgr2=0x7f6b08071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.851+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2247017513 >> v2:172.21.15.142:3300/0 conn(0x7f6b081463a0 0x7f6b08071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.851+0000 7f6b06a00640 1 -- 172.21.15.136:0/2247017513 >> v1:172.21.15.136:6789/0 conn(0x7f6b08072430 legacy=0x7f6b08142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.851+0000 7f6b06a00640 1 -- 172.21.15.136:0/2247017513 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0815d7f0 con 0x7f6b0813ff40 2024-05-04T07:51:40.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2247017513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0813ff40 0x7f6b08145e60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b6e00 tx=0x7f6af802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14782eaf6aa1a3f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b06000640 1 -- 172.21.15.136:0/2247017513 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8037070 con 0x7f6b0813ff40 2024-05-04T07:51:40.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b06000640 1 -- 172.21.15.136:0/2247017513 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af8032440 con 0x7f6b0813ff40 2024-05-04T07:51:40.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b06000640 1 -- 172.21.15.136:0/2247017513 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8032810 con 0x7f6b0813ff40 2024-05-04T07:51:40.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 -- 172.21.15.136:0/2247017513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0813ff40 msgr2=0x7f6b08145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.853 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2247017513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0813ff40 0x7f6b08145e60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6b080b6e00 tx=0x7f6af802a1a0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 -- 172.21.15.136:0/2247017513 shutdown_connections 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2247017513 >> v2:172.21.15.142:3300/0 conn(0x7f6b081463a0 0x7f6b08071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2247017513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0813ff40 0x7f6b08145e60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.852+0000 7f6b0da00640 1 -- 172.21.15.136:0/2247017513 >> 172.21.15.136:0/2247017513 conn(0x7f6b080d0c30 msgr2=0x7f6b080d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.853+0000 7f6b0da00640 1 -- 172.21.15.136:0/2247017513 shutdown_connections 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.853+0000 7f6b0da00640 1 -- 172.21.15.136:0/2247017513 wait complete. 2024-05-04T07:51:40.854 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.854+0000 7f6b0da00640 1 Processor -- start 2024-05-04T07:51:40.855 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.854+0000 7f6b0da00640 1 -- start start 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b0813ff40 0x7f6b081f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b081463a0 0x7f6b080cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6b08161910 con 0x7f6b08072430 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b080c6ac0 con 0x7f6b081463a0 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b0da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0815d4a0 con 0x7f6b0813ff40 2024-05-04T07:51:40.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b06a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b06a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59508/0 (socket says 172.21.15.136:59508) 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.855+0000 7f6b06a00640 1 -- 172.21.15.136:0/2909014281 learned_addr learned my addr 172.21.15.136:0/2909014281 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 -- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b0813ff40 msgr2=0x7f6b081f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b0813ff40 0x7f6b081f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 -- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b081463a0 msgr2=0x7f6b080cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b081463a0 0x7f6b080cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:40.857 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 -- 172.21.15.136:0/2909014281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b081f37e0 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b06a00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000c00 tx=0x7f6af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8037040 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af8042070 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af8030960 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.856+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b080b3cf0 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.857+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b080b42b0 con 0x7f6b08072430 2024-05-04T07:51:40.858 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.858+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b08143710 con 0x7f6b08072430 2024-05-04T07:51:40.859 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.859+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6af8030b00 con 0x7f6b08072430 2024-05-04T07:51:40.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.860+0000 7f6afea00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 0x7f6ae4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:40.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.860+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f6af80b7e50 con 0x7f6b08072430 2024-05-04T07:51:40.860 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.860+0000 7f6affe00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 0x7f6ae4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:40.861 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.861+0000 7f6affe00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 0x7f6ae4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6af0006fd0 tx=0x7f6af0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:40.864 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:40.864+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b081f37e0 con 0x7f6b08072430 2024-05-04T07:51:41.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.076+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6b08069400 con 0x7f6b08072430 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.077+0000 7f6afea00640 1 -- 172.21.15.136:0/2909014281 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f6af80818d0 con 0x7f6b08072430 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stdout:[ 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolnum": 1, 2024-05-04T07:51:41.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolname": ".mgr" 2024-05-04T07:51:41.079 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-04T07:51:41.079 INFO:teuthology.orchestra.run.smithi136.stdout:] 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 msgr2=0x7f6ae4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 0x7f6ae4078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6af0006fd0 tx=0x7f6af0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 msgr2=0x7f6b08141eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6af8000c00 tx=0x7f6af80046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 shutdown_connections 2024-05-04T07:51:41.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6ae40762d0 0x7f6ae4078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b081463a0 0x7f6b080cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b0813ff40 0x7f6b081f32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 --2- 172.21.15.136:0/2909014281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b08072430 0x7f6b08141eb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.080+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 >> 172.21.15.136:0/2909014281 conn(0x7f6b080d0c30 msgr2=0x7f6b0815fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.081+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 shutdown_connections 2024-05-04T07:51:41.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.081+0000 7f6b0da00640 1 -- 172.21.15.136:0/2909014281 wait complete. 2024-05-04T07:51:41.100 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-04T07:51:41.100 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-04T07:51:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.305+0000 7f3652000640 1 Processor -- start 2024-05-04T07:51:41.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.305+0000 7f3652000640 1 -- start start 2024-05-04T07:51:41.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15cd90 0x7f364c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f364c15d170 0x7f364c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f364c0ccad0 0x7f364c0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f364c1614c0 con 0x7f364c0ccad0 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f364c074150 con 0x7f364c15d170 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.306+0000 7f3652000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f364c160b90 con 0x7f364c15cd90 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f364c0ccad0 0x7f364c0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f364c0ccad0 0x7f364c0ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59520/0 (socket says 172.21.15.136:59520) 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 -- 172.21.15.136:0/3636703556 learned_addr learned my addr 172.21.15.136:0/3636703556 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f3643e00640 1 --2- 172.21.15.136:0/3636703556 >> v2:172.21.15.142:3300/0 conn(0x7f364c15d170 0x7f364c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 -- 172.21.15.136:0/3636703556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15cd90 msgr2=0x7f364c073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 --2- 172.21.15.136:0/3636703556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15cd90 0x7f364c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 -- 172.21.15.136:0/3636703556 >> v2:172.21.15.142:3300/0 conn(0x7f364c15d170 msgr2=0x7f364c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:41.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 --2- 172.21.15.136:0/3636703556 >> v2:172.21.15.142:3300/0 conn(0x7f364c15d170 0x7f364c15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.307+0000 7f364be00640 1 -- 172.21.15.136:0/3636703556 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c160e70 con 0x7f364c0ccad0 2024-05-04T07:51:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f364be00640 1 --2- 172.21.15.136:0/3636703556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0ccf60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f364c06d9b0 tx=0x7f364402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd803fae27ac27a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f364aa00640 1 -- 172.21.15.136:0/3636703556 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644036070 con 0x7f364c0ccad0 2024-05-04T07:51:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f364aa00640 1 -- 172.21.15.136:0/3636703556 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644031600 con 0x7f364c0ccad0 2024-05-04T07:51:41.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f364aa00640 1 -- 172.21.15.136:0/3636703556 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440319d0 con 0x7f364c0ccad0 2024-05-04T07:51:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f3652000640 1 -- 172.21.15.136:0/3636703556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 msgr2=0x7f364c0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.309+0000 7f3652000640 1 --2- 172.21.15.136:0/3636703556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0ccf60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f364c06d9b0 tx=0x7f364402a6a0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 -- 172.21.15.136:0/3636703556 shutdown_connections 2024-05-04T07:51:41.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 --2- 172.21.15.136:0/3636703556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0ccf60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 --2- 172.21.15.136:0/3636703556 >> v2:172.21.15.142:3300/0 conn(0x7f364c15d170 0x7f364c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 --2- 172.21.15.136:0/3636703556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15cd90 0x7f364c073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 -- 172.21.15.136:0/3636703556 >> 172.21.15.136:0/3636703556 conn(0x7f364c0d0bf0 msgr2=0x7f364c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 -- 172.21.15.136:0/3636703556 shutdown_connections 2024-05-04T07:51:41.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.310+0000 7f3652000640 1 -- 172.21.15.136:0/3636703556 wait complete. 2024-05-04T07:51:41.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.311+0000 7f3652000640 1 Processor -- start 2024-05-04T07:51:41.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.312+0000 7f3652000640 1 -- start start 2024-05-04T07:51:41.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364c15cd90 0x7f364c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15d170 0x7f364c0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f364c161950 con 0x7f364c0ccad0 2024-05-04T07:51:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f364c0cb240 con 0x7f364c15cd90 2024-05-04T07:51:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3652000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f364c0c8130 con 0x7f364c15d170 2024-05-04T07:51:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59536/0 (socket says 172.21.15.136:59536) 2024-05-04T07:51:41.314 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 -- 172.21.15.136:0/188466138 learned_addr learned my addr 172.21.15.136:0/188466138 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f3643e00640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364c15cd90 0x7f364c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364be00640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15d170 0x7f364c0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 -- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15d170 msgr2=0x7f364c0c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15d170 0x7f364c0c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 -- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364c15cd90 msgr2=0x7f364c150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364c15cd90 0x7f364c150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:41.315 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.313+0000 7f364b400640 1 -- 172.21.15.136:0/188466138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c0c83a0 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f364b400640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c014070 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f363c010610 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c010a00 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364c0c8680 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.314+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364c0c8c40 con 0x7f364c0ccad0 2024-05-04T07:51:41.316 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.315+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364c0b6720 con 0x7f364c0ccad0 2024-05-04T07:51:41.317 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.316+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f363c017070 con 0x7f364c0ccad0 2024-05-04T07:51:41.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.317+0000 7f3643400640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:41.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.317+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f363c096ec0 con 0x7f364c0ccad0 2024-05-04T07:51:41.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.318+0000 7f3643e00640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:41.318 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.318+0000 7f3643e00640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 0x7f3628078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f364c1f66e0 tx=0x7f3634008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:41.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.322+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f363c0609d0 con 0x7f364c0ccad0 2024-05-04T07:51:41.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:41.531+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f364c0694e0 con 0x7f364c0ccad0 2024-05-04T07:51:42.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.056+0000 7f3643400640 1 -- 172.21.15.136:0/188466138 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f363c0602d0 con 0x7f364c0ccad0 2024-05-04T07:51:42.057 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' created 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 msgr2=0x7f3628078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 0x7f3628078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f364c1f66e0 tx=0x7f3634008040 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 msgr2=0x7f364c0b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c00b960 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 shutdown_connections 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f36280762d0 0x7f3628078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f364c15d170 0x7f364c0c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f364c15cd90 0x7f364c150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 --2- 172.21.15.136:0/188466138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f364c0ccad0 0x7f364c0b6180 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 >> 172.21.15.136:0/188466138 conn(0x7f364c0d0bf0 msgr2=0x7f364c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 shutdown_connections 2024-05-04T07:51:42.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.061+0000 7f3652000640 1 -- 172.21.15.136:0/188466138 wait complete. 2024-05-04T07:51:42.090 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-04T07:51:42.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.287+0000 7ff86da00640 1 Processor -- start 2024-05-04T07:51:42.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.287+0000 7ff86da00640 1 -- start start 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.288+0000 7ff86da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff868163540 0x7ff8680cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.288+0000 7ff86da00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8680720b0 0x7ff8680af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.288+0000 7ff86da00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8680cc090 con 0x7ff86815f2d0 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.288+0000 7ff86da00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff8680cbb10 con 0x7ff8680720b0 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.288+0000 7ff86da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8680d0240 con 0x7ff868163540 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.289+0000 7ff867400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8680720b0 0x7ff8680af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.289+0000 7ff867400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8680720b0 0x7ff8680af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:57574/0 (socket says 172.21.15.136:57574) 2024-05-04T07:51:42.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.289+0000 7ff867400640 1 -- 172.21.15.136:0/2833959079 learned_addr learned my addr 172.21.15.136:0/2833959079 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:42.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.289+0000 7ff85fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff868163540 0x7ff8680cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.290+0000 7ff867400640 1 -- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff868163540 msgr2=0x7ff8680cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:42.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.290+0000 7ff867400640 1 --2- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff868163540 0x7ff8680cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.290+0000 7ff867400640 1 -- 172.21.15.136:0/2833959079 >> v1:172.21.15.142:6789/0 conn(0x7ff86815f2d0 legacy=0x7ff868162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.290+0000 7ff867400640 1 -- 172.21.15.136:0/2833959079 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8680d0520 con 0x7ff8680720b0 2024-05-04T07:51:42.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.291+0000 7ff867400640 1 --2- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8680720b0 0x7ff8680af440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff860009e50 tx=0x7ff86002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44755130d2769656 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:42.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff866000640 1 -- 172.21.15.136:0/2833959079 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860036070 con 0x7ff8680720b0 2024-05-04T07:51:42.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff866000640 1 -- 172.21.15.136:0/2833959079 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff860031600 con 0x7ff8680720b0 2024-05-04T07:51:42.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff866000640 1 -- 172.21.15.136:0/2833959079 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8600319d0 con 0x7ff8680720b0 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 -- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8680720b0 msgr2=0x7ff8680af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 --2- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8680720b0 0x7ff8680af440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff860009e50 tx=0x7ff86002a710 comp rx=0 tx=0).stop 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 -- 172.21.15.136:0/2833959079 shutdown_connections 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 --2- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff868163540 0x7ff8680cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 --2- 172.21.15.136:0/2833959079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8680720b0 0x7ff8680af440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 -- 172.21.15.136:0/2833959079 >> 172.21.15.136:0/2833959079 conn(0x7ff8680d0c50 msgr2=0x7ff8680d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:42.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.292+0000 7ff86da00640 1 -- 172.21.15.136:0/2833959079 shutdown_connections 2024-05-04T07:51:42.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.293+0000 7ff86da00640 1 -- 172.21.15.136:0/2833959079 wait complete. 2024-05-04T07:51:42.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.294+0000 7ff86da00640 1 Processor -- start 2024-05-04T07:51:42.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.294+0000 7ff86da00640 1 -- start start 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 0x7ff8680b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff868163540 0x7ff86815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff868163b30 con 0x7ff8680720b0 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff8680cc370 con 0x7ff868163540 2024-05-04T07:51:42.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.295+0000 7ff86da00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff8680b3990 con 0x7ff86815f2d0 2024-05-04T07:51:42.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59546/0 (socket says 172.21.15.136:59546) 2024-05-04T07:51:42.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 -- 172.21.15.136:0/3096032960 learned_addr learned my addr 172.21.15.136:0/3096032960 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff867400640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff868163540 0x7ff86815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff85fe00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 0x7ff8680b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 -- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 msgr2=0x7ff8680b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 0x7ff8680b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 -- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff868163540 msgr2=0x7ff86815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff868163540 0x7ff86815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:42.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff866a00640 1 -- 172.21.15.136:0/3096032960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8680c9c20 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.296+0000 7ff85fe00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 0x7ff8680b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff866a00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c450 tx=0x7ff85800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8580052d0 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff858005470 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858012870 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff868154330 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.297+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8680b3c00 con 0x7ff8680720b0 2024-05-04T07:51:42.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.298+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff868069470 con 0x7ff8680720b0 2024-05-04T07:51:42.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.300+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff858012a10 con 0x7ff8680720b0 2024-05-04T07:51:42.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.301+0000 7ff85ea00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 0x7ff844078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:42.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.301+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7ff858097260 con 0x7ff8680720b0 2024-05-04T07:51:42.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.301+0000 7ff85fe00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 0x7ff844078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:42.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.302+0000 7ff85fe00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 0x7ff844078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff86815e3b0 tx=0x7ff850008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:42.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.306+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff858060b70 con 0x7ff8680720b0 2024-05-04T07:51:42.512 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:42.511+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff8680b6920 con 0x7ff8680720b0 2024-05-04T07:51:43.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.073+0000 7ff85ea00640 1 -- 172.21.15.136:0/3096032960 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7ff858060470 con 0x7ff8680720b0 2024-05-04T07:51:43.074 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' created 2024-05-04T07:51:43.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 msgr2=0x7ff844078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 0x7ff844078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff86815e3b0 tx=0x7ff850008040 comp rx=0 tx=0).stop 2024-05-04T07:51:43.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 msgr2=0x7ff868153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c450 tx=0x7ff85800c910 comp rx=0 tx=0).stop 2024-05-04T07:51:43.079 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 shutdown_connections 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7ff8440762d0 0x7ff844078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff868163540 0x7ff86815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff86815f2d0 0x7ff8680b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 --2- 172.21.15.136:0/3096032960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff8680720b0 0x7ff868153df0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.078+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 >> 172.21.15.136:0/3096032960 conn(0x7ff8680d0c50 msgr2=0x7ff8680d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:43.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.080+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 shutdown_connections 2024-05-04T07:51:43.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.080+0000 7ff86da00640 1 -- 172.21.15.136:0/3096032960 wait complete. 2024-05-04T07:51:43.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-04T07:51:43.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.293+0000 7f2a1b600640 1 Processor -- start 2024-05-04T07:51:43.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.293+0000 7f2a1b600640 1 -- start start 2024-05-04T07:51:43.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a1b600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1415ad40 0x7f2a1406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a1b600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a1b600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a140701e0 con 0x7f2a14072920 2024-05-04T07:51:43.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a1b600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1415df70 con 0x7f2a1415ad40 2024-05-04T07:51:43.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a1b600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1406ff90 con 0x7f2a14073d50 2024-05-04T07:51:43.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a18c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1415ad40 0x7f2a1406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:43.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:43.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a18c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2a1415ad40 0x7f2a1406fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:57584/0 (socket says 172.21.15.136:57584) 2024-05-04T07:51:43.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.295+0000 7f2a18c00640 1 -- 172.21.15.136:0/3128982900 learned_addr learned my addr 172.21.15.136:0/3128982900 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:43.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.296+0000 7f2a18c00640 1 -- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 msgr2=0x7f2a140723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:43.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.296+0000 7f2a18c00640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.296+0000 7f2a18c00640 1 -- 172.21.15.136:0/3128982900 >> v1:172.21.15.142:6789/0 conn(0x7f2a14072920 legacy=0x7f2a140cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.297+0000 7f2a18c00640 1 -- 172.21.15.136:0/3128982900 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1415d640 con 0x7f2a1415ad40 2024-05-04T07:51:43.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.297+0000 7f2a13e00640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:51:43.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.298+0000 7f2a18c00640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a1406fa50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a0402a240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee98c30f24207b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:43.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.298+0000 7f2a13400640 1 -- 172.21.15.136:0/3128982900 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04037070 con 0x7f2a1415ad40 2024-05-04T07:51:43.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.298+0000 7f2a13400640 1 -- 172.21.15.136:0/3128982900 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04032440 con 0x7f2a1415ad40 2024-05-04T07:51:43.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.298+0000 7f2a13400640 1 -- 172.21.15.136:0/3128982900 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04032810 con 0x7f2a1415ad40 2024-05-04T07:51:43.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 -- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 msgr2=0x7f2a1406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a1406fa50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a0402a240 comp rx=0 tx=0).stop 2024-05-04T07:51:43.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 -- 172.21.15.136:0/3128982900 shutdown_connections 2024-05-04T07:51:43.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 --2- 172.21.15.136:0/3128982900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a1406fa50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 -- 172.21.15.136:0/3128982900 >> 172.21.15.136:0/3128982900 conn(0x7f2a140d0c50 msgr2=0x7f2a140d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:43.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 -- 172.21.15.136:0/3128982900 shutdown_connections 2024-05-04T07:51:43.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.299+0000 7f2a1b600640 1 -- 172.21.15.136:0/3128982900 wait complete. 2024-05-04T07:51:43.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.301+0000 7f2a1b600640 1 Processor -- start 2024-05-04T07:51:43.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.301+0000 7f2a1b600640 1 -- start start 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a140afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2a140731a0 con 0x7f2a14072920 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415dc00 con 0x7f2a1415ad40 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a1b600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1415e400 con 0x7f2a14073d50 2024-05-04T07:51:43.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a18c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a18c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59556/0 (socket says 172.21.15.136:59556) 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.302+0000 7f2a18c00640 1 -- 172.21.15.136:0/1184142215 learned_addr learned my addr 172.21.15.136:0/1184142215 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a19600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a140afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a18c00640 1 -- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 msgr2=0x7f2a140b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a18c00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a18c00640 1 -- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 msgr2=0x7f2a140afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:43.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a18c00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a140afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.303+0000 7f2a18c00640 1 -- 172.21.15.136:0/1184142215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1414f610 con 0x7f2a14072920 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a18c00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a04000c00 tx=0x7f2a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04037040 con 0x7f2a14072920 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04042070 con 0x7f2a14072920 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04030880 con 0x7f2a14072920 2024-05-04T07:51:43.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a140b4b90 con 0x7f2a14072920 2024-05-04T07:51:43.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.304+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a140b5150 con 0x7f2a14072920 2024-05-04T07:51:43.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.305+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a14069470 con 0x7f2a14072920 2024-05-04T07:51:43.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.307+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2a04030a20 con 0x7f2a14072920 2024-05-04T07:51:43.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.308+0000 7f2a10c00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 0x7f29f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:43.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.308+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f2a040b8080 con 0x7f2a14072920 2024-05-04T07:51:43.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.308+0000 7f2a13e00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 0x7f29f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:43.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.309+0000 7f2a13e00640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 0x7f29f4078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006e80 tx=0x7f2a00006dd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:43.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.313+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2a1414f610 con 0x7f2a14072920 2024-05-04T07:51:43.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:43.551+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2a140d17d0 con 0x7f2a14072920 2024-05-04T07:51:44.106 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.101+0000 7f2a10c00640 1 -- 172.21.15.136:0/1184142215 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) ==== 172+0+0 (secure 0 0 0) 0x7f2a04081810 con 0x7f2a14072920 2024-05-04T07:51:44.106 INFO:teuthology.orchestra.run.smithi136.stderr:new fs with metadata pool 5 and data pool 6 2024-05-04T07:51:44.112 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.112+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 msgr2=0x7f29f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.112+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 0x7f29f4078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006e80 tx=0x7f2a00006dd0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.112+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 msgr2=0x7f2a1414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.113 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.112+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a04000c00 tx=0x7f2a040046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 shutdown_connections 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f29f40762d0 0x7f29f4078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a1415ad40 0x7f2a140afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a14073d50 0x7f2a140b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 --2- 172.21.15.136:0/1184142215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a14072920 0x7f2a1414f0d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 >> 172.21.15.136:0/1184142215 conn(0x7f2a140d0c50 msgr2=0x7f2a1415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 shutdown_connections 2024-05-04T07:51:44.119 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.118+0000 7f2a1b600640 1 -- 172.21.15.136:0/1184142215 wait complete. 2024-05-04T07:51:44.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:44.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:51:44.266 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:51:44.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.322+0000 7f91b2a00640 1 Processor -- start 2024-05-04T07:51:44.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.322+0000 7f91b2a00640 1 -- start start 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.323+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 0x7f91ac0d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.323+0000 7f91b2a00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91ac0d5ce0 0x7f91ac0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.323+0000 7f91b2a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac0cfe90 con 0x7f91ac0d36c0 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.323+0000 7f91b2a00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac0cfc60 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.323+0000 7f91b2a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac0d0170 con 0x7f91ac15f3f0 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91b0a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f91ac0d36c0 0x7f91ac0c8c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48742/0 (socket says 172.21.15.136:48742) 2024-05-04T07:51:44.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91b0a00640 1 -- 172.21.15.136:0/3862086830 learned_addr learned my addr 172.21.15.136:0/3862086830 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91abe00640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 0x7f91ac0d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91ab400640 1 --2- 172.21.15.136:0/3862086830 >> v2:172.21.15.142:3300/0 conn(0x7f91ac0d5ce0 0x7f91ac0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91aaa00640 1 -- 172.21.15.136:0/3862086830 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98806718 0 0) 0x7f91ac0cfe90 con 0x7f91ac0d36c0 2024-05-04T07:51:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91aaa00640 1 -- 172.21.15.136:0/3862086830 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9190003520 con 0x7f91ac0d36c0 2024-05-04T07:51:44.325 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91ab400640 1 -- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 msgr2=0x7f91ac0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:44.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91ab400640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 0x7f91ac0d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91ab400640 1 -- 172.21.15.136:0/3862086830 >> v1:172.21.15.136:6789/0 conn(0x7f91ac0d36c0 legacy=0x7f91ac0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91ab400640 1 -- 172.21.15.136:0/3862086830 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0d0450 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.326 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.324+0000 7f91abe00640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 0x7f91ac0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:51:44.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91ab400640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac0d2ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91980097a0 tx=0x7f919802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187d45732ec088a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.327 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91aaa00640 1 -- 172.21.15.136:0/3862086830 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198037070 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91aaa00640 1 -- 172.21.15.136:0/3862086830 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9198032440 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91aaa00640 1 -- 172.21.15.136:0/3862086830 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980327f0 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91b2a00640 1 -- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac0d5ce0 msgr2=0x7f91ac0d2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.326+0000 7f91b2a00640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac0d2ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91980097a0 tx=0x7f919802a230 comp rx=0 tx=0).stop 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 -- 172.21.15.136:0/3862086830 shutdown_connections 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac0d2ec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 --2- 172.21.15.136:0/3862086830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac15f3f0 0x7f91ac0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 -- 172.21.15.136:0/3862086830 >> 172.21.15.136:0/3862086830 conn(0x7f91ac0d50e0 msgr2=0x7f91ac0d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 -- 172.21.15.136:0/3862086830 shutdown_connections 2024-05-04T07:51:44.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.327+0000 7f91b2a00640 1 -- 172.21.15.136:0/3862086830 wait complete. 2024-05-04T07:51:44.329 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.328+0000 7f91b2a00640 1 Processor -- start 2024-05-04T07:51:44.329 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.328+0000 7f91b2a00640 1 -- start start 2024-05-04T07:51:44.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac0d36c0 0x7f91ac1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.331 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac15f3f0 0x7f91ac160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0d3400 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0d0a10 con 0x7f91ac15f3f0 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.329+0000 7f91b2a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac15f7d0 con 0x7f91ac0d36c0 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53892/0 (socket says 172.21.15.136:53892) 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 -- 172.21.15.136:0/1301977909 learned_addr learned my addr 172.21.15.136:0/1301977909 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91abe00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac0d36c0 0x7f91ac1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 -- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac0d36c0 msgr2=0x7f91ac1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac0d36c0 0x7f91ac1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 -- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac15f3f0 msgr2=0x7f91ac160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac15f3f0 0x7f91ac160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.332 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 -- 172.21.15.136:0/1301977909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0cc1b0 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.330+0000 7f91ab400640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f91980097a0 tx=0x7f91980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.331+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198037050 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.331+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9198043070 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.331+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198006e10 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.331+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac159c10 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.331+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac0cc730 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.332+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac069400 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.333+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9198032810 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.334+0000 7f91a3e00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 0x7f918c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.334+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f91980b8100 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.334+0000 7f91abe00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 0x7f918c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.335+0000 7f91abe00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 0x7f918c0787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f919c009560 tx=0x7f919c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.339+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91980818c0 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.545 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.545+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91ac0d2690 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.548+0000 7f91a3e00640 1 -- 172.21.15.136:0/1301977909 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17015 (secure 0 0 0) 0x7f91980811c0 con 0x7f91ac0d5ce0 2024-05-04T07:51:44.549 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:44.549 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":38,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:43.553326+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:51:41.545546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-04T07:51:42.525458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:44.551 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 msgr2=0x7f918c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 0x7f918c0787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f919c009560 tx=0x7f919c009190 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 msgr2=0x7f91ac158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f91980097a0 tx=0x7f91980046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 shutdown_connections 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f918c076300 0x7f918c0787c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91ac15f3f0 0x7f91ac160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91ac0d5ce0 0x7f91ac158f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 --2- 172.21.15.136:0/1301977909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91ac0d36c0 0x7f91ac1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 >> 172.21.15.136:0/1301977909 conn(0x7f91ac0d50e0 msgr2=0x7f91ac0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:44.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 shutdown_connections 2024-05-04T07:51:44.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.551+0000 7f91b2a00640 1 -- 172.21.15.136:0/1301977909 wait complete. 2024-05-04T07:51:44.570 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:44.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.766+0000 7f3f36e00640 1 Processor -- start 2024-05-04T07:51:44.767 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.766+0000 7f3f36e00640 1 -- start start 2024-05-04T07:51:44.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.767+0000 7f3f36e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3f300d3460 0x7f3f300d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.767+0000 7f3f36e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f300b31f0 0x7f3f300b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.767+0000 7f3f36e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f300d3d80 con 0x7f3f300b1c60 2024-05-04T07:51:44.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.767+0000 7f3f36e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3f300b2170 con 0x7f3f300d3460 2024-05-04T07:51:44.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.767+0000 7f3f36e00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3f300b2430 con 0x7f3f300b31f0 2024-05-04T07:51:44.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3f300d3460 0x7f3f300d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3f300b1c60 0x7f3f300d59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48750/0 (socket says 172.21.15.136:48750) 2024-05-04T07:51:44.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3f300d3460 0x7f3f300d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53894/0 (socket says 172.21.15.136:53894) 2024-05-04T07:51:44.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35000640 1 -- 172.21.15.136:0/3076217988 learned_addr learned my addr 172.21.15.136:0/3076217988 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f36400640 1 --2- 172.21.15.136:0/3076217988 >> v2:172.21.15.142:3300/0 conn(0x7f3f300b31f0 0x7f3f300b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35a00640 1 -- 172.21.15.136:0/3076217988 >> v2:172.21.15.142:3300/0 conn(0x7f3f300b31f0 msgr2=0x7f3f300b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35a00640 1 --2- 172.21.15.136:0/3076217988 >> v2:172.21.15.142:3300/0 conn(0x7f3f300b31f0 0x7f3f300b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.768+0000 7f3f35a00640 1 -- 172.21.15.136:0/3076217988 >> v1:172.21.15.136:6789/0 conn(0x7f3f300b1c60 legacy=0x7f3f300d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.769+0000 7f3f35a00640 1 -- 172.21.15.136:0/3076217988 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f300b2710 con 0x7f3f300d3460 2024-05-04T07:51:44.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.769+0000 7f3f2fe00640 1 -- 172.21.15.136:0/3076217988 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709801835 0 0) 0x7f3f300d3d80 con 0x7f3f300b1c60 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f35a00640 1 --2- 172.21.15.136:0/3076217988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f300d3840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f3008e2d0 tx=0x7f3f2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5fa1fc7989b847 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f2fe00640 1 -- 172.21.15.136:0/3076217988 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24037070 con 0x7f3f300d3460 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f2fe00640 1 -- 172.21.15.136:0/3076217988 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f24032440 con 0x7f3f300d3460 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f2fe00640 1 -- 172.21.15.136:0/3076217988 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2402ae60 con 0x7f3f300d3460 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f36e00640 1 -- 172.21.15.136:0/3076217988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 msgr2=0x7f3f300d3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.770+0000 7f3f36e00640 1 --2- 172.21.15.136:0/3076217988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f300d3840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f3008e2d0 tx=0x7f3f2402a110 comp rx=0 tx=0).stop 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 -- 172.21.15.136:0/3076217988 shutdown_connections 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 --2- 172.21.15.136:0/3076217988 >> v2:172.21.15.142:3300/0 conn(0x7f3f300b31f0 0x7f3f300b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 --2- 172.21.15.136:0/3076217988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f300d3840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 -- 172.21.15.136:0/3076217988 >> 172.21.15.136:0/3076217988 conn(0x7f3f3009e370 msgr2=0x7f3f300d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 -- 172.21.15.136:0/3076217988 shutdown_connections 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.771+0000 7f3f36e00640 1 -- 172.21.15.136:0/3076217988 wait complete. 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.772+0000 7f3f36e00640 1 Processor -- start 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 -- start start 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 0x7f3f300d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f300b31f0 0x7f3f301510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30163ae0 con 0x7f3f300d3460 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f300b2cd0 con 0x7f3f300b31f0 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.773+0000 7f3f36e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3f30163c60 con 0x7f3f300b1c60 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53906/0 (socket says 172.21.15.136:53906) 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 -- 172.21.15.136:0/4026986481 learned_addr learned my addr 172.21.15.136:0/4026986481 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f35000640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f300b31f0 0x7f3f301510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f35a00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 0x7f3f300d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 -- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 msgr2=0x7f3f300d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 0x7f3f300d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 -- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f300b31f0 msgr2=0x7f3f301510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f300b31f0 0x7f3f301510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f36400640 1 -- 172.21.15.136:0/4026986481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f300b9f30 con 0x7f3f300d3460 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.774+0000 7f3f35a00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 0x7f3f300d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f36400640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800efc0 tx=0x7f3f2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28018020 con 0x7f3f300d3460 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28014480 con 0x7f3f300d3460 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28014870 con 0x7f3f300d3460 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f300ba210 con 0x7f3f300d3460 2024-05-04T07:51:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.775+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f300ba7d0 con 0x7f3f300d3460 2024-05-04T07:51:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.776+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f30069400 con 0x7f3f300d3460 2024-05-04T07:51:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.777+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f28005d10 con 0x7f3f300d3460 2024-05-04T07:51:44.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.778+0000 7f3f2d600640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 0x7f3f10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:44.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.778+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3f28098230 con 0x7f3f300d3460 2024-05-04T07:51:44.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.779+0000 7f3f35a00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 0x7f3f10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:44.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.779+0000 7f3f35a00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 0x7f3f10078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f24034000 tx=0x7f3f2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:44.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.783+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f28022070 con 0x7f3f300d3460 2024-05-04T07:51:44.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.990+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f3008f120 con 0x7f3f300d3460 2024-05-04T07:51:44.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.993+0000 7f3f2d600640 1 -- 172.21.15.136:0/4026986481 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17015 (secure 0 0 0) 0x7f3f28010040 con 0x7f3f300d3460 2024-05-04T07:51:44.994 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:44.994 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":38,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:43.553326+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:51:41.545546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-04T07:51:42.525458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 msgr2=0x7f3f10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 0x7f3f10078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f24034000 tx=0x7f3f2402e000 comp rx=0 tx=0).stop 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 msgr2=0x7f3f30151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800efc0 tx=0x7f3f2800c490 comp rx=0 tx=0).stop 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 shutdown_connections 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3f100762d0 0x7f3f10078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3f300d3460 0x7f3f30151610 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f300b31f0 0x7f3f301510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 --2- 172.21.15.136:0/4026986481 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f300b1c60 0x7f3f300d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:44.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 >> 172.21.15.136:0/4026986481 conn(0x7f3f3009e370 msgr2=0x7f3f300b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:44.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 shutdown_connections 2024-05-04T07:51:44.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:44.996+0000 7f3f36e00640 1 -- 172.21.15.136:0/4026986481 wait complete. 2024-05-04T07:51:45.016 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-04T07:51:45.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.216+0000 7f6567800640 1 Processor -- start 2024-05-04T07:51:45.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.216+0000 7f6567800640 1 -- start start 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.217+0000 7f6567800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6560071ed0 0x7f65600cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.217+0000 7f6567800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65600cb7b0 0x7f656006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6567800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65600ced70 con 0x7f65600ce820 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6567800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f65600c45c0 con 0x7f65600cb7b0 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6567800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f65600cf050 con 0x7f6560071ed0 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f655fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f65600ce820 0x7f65600722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48752/0 (socket says 172.21.15.136:48752) 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f655fe00640 1 -- 172.21.15.136:0/1397890367 learned_addr learned my addr 172.21.15.136:0/1397890367 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:45.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6565800640 1 --2- 172.21.15.136:0/1397890367 >> v2:172.21.15.136:3300/0 conn(0x7f65600cb7b0 0x7f656006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6564e00640 1 --2- 172.21.15.136:0/1397890367 >> v2:172.21.15.142:3300/0 conn(0x7f6560071ed0 0x7f65600cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f655f400640 1 -- 172.21.15.136:0/1397890367 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018067862 0 0) 0x7f65600ced70 con 0x7f65600ce820 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f655f400640 1 -- 172.21.15.136:0/1397890367 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6548003520 con 0x7f65600ce820 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6565800640 1 -- 172.21.15.136:0/1397890367 >> v2:172.21.15.142:3300/0 conn(0x7f6560071ed0 msgr2=0x7f65600cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.218+0000 7f6565800640 1 --2- 172.21.15.136:0/1397890367 >> v2:172.21.15.142:3300/0 conn(0x7f6560071ed0 0x7f65600cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.219+0000 7f6565800640 1 -- 172.21.15.136:0/1397890367 >> v1:172.21.15.136:6789/0 conn(0x7f65600ce820 legacy=0x7f65600722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:45.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.219+0000 7f6565800640 1 -- 172.21.15.136:0/1397890367 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600cf330 con 0x7f65600cb7b0 2024-05-04T07:51:45.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f6565800640 1 --2- 172.21.15.136:0/1397890367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600cb7b0 0x7f656006dc50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6558009d90 tx=0x7f655802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f63ba595b317549 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:45.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f655f400640 1 -- 172.21.15.136:0/1397890367 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558007740 con 0x7f65600cb7b0 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f655f400640 1 -- 172.21.15.136:0/1397890367 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65580078e0 con 0x7f65600cb7b0 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f655f400640 1 -- 172.21.15.136:0/1397890367 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558007c90 con 0x7f65600cb7b0 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f6567800640 1 -- 172.21.15.136:0/1397890367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600cb7b0 msgr2=0x7f656006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.220+0000 7f6567800640 1 --2- 172.21.15.136:0/1397890367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600cb7b0 0x7f656006dc50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6558009d90 tx=0x7f655802a6a0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 -- 172.21.15.136:0/1397890367 shutdown_connections 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 --2- 172.21.15.136:0/1397890367 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600cb7b0 0x7f656006dc50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 --2- 172.21.15.136:0/1397890367 >> v2:172.21.15.142:3300/0 conn(0x7f6560071ed0 0x7f65600cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 -- 172.21.15.136:0/1397890367 >> 172.21.15.136:0/1397890367 conn(0x7f65600d0c50 msgr2=0x7f65600d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 -- 172.21.15.136:0/1397890367 shutdown_connections 2024-05-04T07:51:45.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.221+0000 7f6567800640 1 -- 172.21.15.136:0/1397890367 wait complete. 2024-05-04T07:51:45.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.222+0000 7f6567800640 1 Processor -- start 2024-05-04T07:51:45.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 -- start start 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6560071ed0 0x7f6560161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65600cb7b0 0x7f65601572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6560166e00 con 0x7f65600ce820 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65600cf8f0 con 0x7f6560071ed0 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.223+0000 7f6567800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f65600d08c0 con 0x7f65600cb7b0 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53934/0 (socket says 172.21.15.136:53934) 2024-05-04T07:51:45.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 -- 172.21.15.136:0/2898931865 learned_addr learned my addr 172.21.15.136:0/2898931865 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:45.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6564e00640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6560071ed0 0x7f6560161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f655fe00640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65600cb7b0 0x7f65601572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 -- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65600cb7b0 msgr2=0x7f65601572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65600cb7b0 0x7f65601572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 -- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6560071ed0 msgr2=0x7f6560161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6560071ed0 0x7f6560161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.224+0000 7f6565800640 1 -- 172.21.15.136:0/2898931865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65600c70c0 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f6565800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6558009eb0 tx=0x7f6558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558040070 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558031c40 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6560157820 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558009450 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.225+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65600c4990 con 0x7f65600ce820 2024-05-04T07:51:45.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.226+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6560069470 con 0x7f65600ce820 2024-05-04T07:51:45.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.227+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6558039040 con 0x7f65600ce820 2024-05-04T07:51:45.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.228+0000 7f655cc00640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 0x7f6540078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.228+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f65580b8960 con 0x7f65600ce820 2024-05-04T07:51:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.229+0000 7f6564e00640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 0x7f6540078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:45.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.229+0000 7f6564e00640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 0x7f6540078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6554006fd0 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:45.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.233+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6558082090 con 0x7f65600ce820 2024-05-04T07:51:45.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:45.484+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f656006ff00 con 0x7f65600ce820 2024-05-04T07:51:46.030 INFO:tasks.ceph.mds.a.smithi136.stderr:2024-05-04T07:51:46.030+0000 7f3854000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-04T07:51:46.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.121+0000 7f655cc00640 1 -- 172.21.15.136:0/2898931865 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f6558081990 con 0x7f65600ce820 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 msgr2=0x7f6540078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 0x7f6540078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6554006fd0 tx=0x7f6554008040 comp rx=0 tx=0).stop 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 msgr2=0x7f65600b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6558009eb0 tx=0x7f6558004a40 comp rx=0 tx=0).stop 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 shutdown_connections 2024-05-04T07:51:46.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65400762d0 0x7f6540078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65600ce820 0x7f65600b4300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65600cb7b0 0x7f65601572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 --2- 172.21.15.136:0/2898931865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6560071ed0 0x7f6560161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 >> 172.21.15.136:0/2898931865 conn(0x7f65600d0c50 msgr2=0x7f65600cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 shutdown_connections 2024-05-04T07:51:46.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.125+0000 7f6567800640 1 -- 172.21.15.136:0/2898931865 wait complete. 2024-05-04T07:51:46.147 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-04T07:51:46.147 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-04T07:51:46.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.334+0000 7feb5fe00640 1 Processor -- start 2024-05-04T07:51:46.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.334+0000 7feb5fe00640 1 -- start start 2024-05-04T07:51:46.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.335+0000 7feb5fe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb6015cde0 0x7feb600cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb600cccb0 0x7feb6006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5fe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb600cd150 con 0x7feb60071e50 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5fe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7feb6006df50 con 0x7feb600cccb0 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5fe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feb6006e230 con 0x7feb6015cde0 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5f400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb600cccb0 0x7feb6006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5f400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb600cccb0 0x7feb6006ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53950/0 (socket says 172.21.15.136:53950) 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5f400640 1 -- 172.21.15.136:0/1983169484 learned_addr learned my addr 172.21.15.136:0/1983169484 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:46.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.336+0000 7feb5ea00640 1 --2- 172.21.15.136:0/1983169484 >> v2:172.21.15.142:3300/0 conn(0x7feb6015cde0 0x7feb600cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.337+0000 7feb5f400640 1 -- 172.21.15.136:0/1983169484 >> v2:172.21.15.142:3300/0 conn(0x7feb6015cde0 msgr2=0x7feb600cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.337+0000 7feb5f400640 1 --2- 172.21.15.136:0/1983169484 >> v2:172.21.15.142:3300/0 conn(0x7feb6015cde0 0x7feb600cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.337+0000 7feb5f400640 1 -- 172.21.15.136:0/1983169484 >> v1:172.21.15.136:6789/0 conn(0x7feb60071e50 legacy=0x7feb600cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.337+0000 7feb5f400640 1 -- 172.21.15.136:0/1983169484 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6006e510 con 0x7feb600cccb0 2024-05-04T07:51:46.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5f400640 1 --2- 172.21.15.136:0/1983169484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb600cccb0 0x7feb6006ea30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb6006fde0 tx=0x7feb5802a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9b983bede27e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5d600640 1 -- 172.21.15.136:0/1983169484 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58036070 con 0x7feb600cccb0 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5d600640 1 -- 172.21.15.136:0/1983169484 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb58031600 con 0x7feb600cccb0 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5d600640 1 -- 172.21.15.136:0/1983169484 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb580319d0 con 0x7feb600cccb0 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5fe00640 1 -- 172.21.15.136:0/1983169484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb600cccb0 msgr2=0x7feb6006ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.338+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1983169484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb600cccb0 0x7feb6006ea30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb6006fde0 tx=0x7feb5802a740 comp rx=0 tx=0).stop 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 -- 172.21.15.136:0/1983169484 shutdown_connections 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1983169484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb600cccb0 0x7feb6006ea30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1983169484 >> v2:172.21.15.142:3300/0 conn(0x7feb6015cde0 0x7feb600cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 -- 172.21.15.136:0/1983169484 >> 172.21.15.136:0/1983169484 conn(0x7feb600d0b40 msgr2=0x7feb600d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:46.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 -- 172.21.15.136:0/1983169484 shutdown_connections 2024-05-04T07:51:46.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.339+0000 7feb5fe00640 1 -- 172.21.15.136:0/1983169484 wait complete. 2024-05-04T07:51:46.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.340+0000 7feb5fe00640 1 Processor -- start 2024-05-04T07:51:46.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 -- start start 2024-05-04T07:51:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 0x7feb600ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6015cde0 0x7feb60150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb600b3b50 con 0x7feb60071e50 2024-05-04T07:51:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feb600b39d0 con 0x7feb600cccb0 2024-05-04T07:51:46.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.341+0000 7feb5fe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feb600cb8a0 con 0x7feb6015cde0 2024-05-04T07:51:46.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53954/0 (socket says 172.21.15.136:53954) 2024-05-04T07:51:46.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 -- 172.21.15.136:0/1107869623 learned_addr learned my addr 172.21.15.136:0/1107869623 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:46.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5e000640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 0x7feb600ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 -- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6015cde0 msgr2=0x7feb60150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5f400640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6015cde0 0x7feb60150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6015cde0 0x7feb60150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 -- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 msgr2=0x7feb600ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 0x7feb600ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5ea00640 1 -- 172.21.15.136:0/1107869623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb600af320 con 0x7feb60071e50 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.342+0000 7feb5e000640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 0x7feb600ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:51:46.345 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb5ea00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d800 tx=0x7feb5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000b6c0 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50019070 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000ba80 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb600af600 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.343+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb600afea0 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.344+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb600af7d0 con 0x7feb60071e50 2024-05-04T07:51:46.346 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.345+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feb5000bc20 con 0x7feb60071e50 2024-05-04T07:51:46.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.346+0000 7feb56a00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 0x7feb40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:46.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.346+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7feb50097d00 con 0x7feb60071e50 2024-05-04T07:51:46.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.346+0000 7feb5e000640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 0x7feb40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:46.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.347+0000 7feb5e000640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 0x7feb40078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007fd0 tx=0x7feb4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:46.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.351+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feb50061430 con 0x7feb60071e50 2024-05-04T07:51:46.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:46.590+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feb60069400 con 0x7feb60071e50 2024-05-04T07:51:47.134 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.132+0000 7feb56a00640 1 -- 172.21.15.136:0/1107869623 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7feb50060d30 con 0x7feb60071e50 2024-05-04T07:51:47.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 msgr2=0x7feb40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 0x7feb40078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007fd0 tx=0x7feb4c009040 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 msgr2=0x7feb6015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d800 tx=0x7feb5000dcc0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 shutdown_connections 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7feb400762d0 0x7feb40078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6015cde0 0x7feb60150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb600cccb0 0x7feb600ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 --2- 172.21.15.136:0/1107869623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb60071e50 0x7feb6015f2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 >> 172.21.15.136:0/1107869623 conn(0x7feb600d0b40 msgr2=0x7feb600b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 shutdown_connections 2024-05-04T07:51:47.138 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.136+0000 7feb5fe00640 1 -- 172.21.15.136:0/1107869623 wait complete. 2024-05-04T07:51:47.159 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-04T07:51:47.159 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:47.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.359+0000 7f4ff6200640 1 Processor -- start 2024-05-04T07:51:47.361 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.359+0000 7f4ff6200640 1 -- start start 2024-05-04T07:51:47.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4ff6200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4ff015fa20 0x7f4ff015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4ff6200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff00cc0a0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4ff6200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff0160830 con 0x7f4ff0160340 2024-05-04T07:51:47.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4ff6200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff00cf4f0 con 0x7f4ff015fa20 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4fef400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4ff015fa20 0x7f4ff015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4fefe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4ff00cffd0 0x7f4ff00cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48768/0 (socket says 172.21.15.136:48768) 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4fefe00640 1 -- 172.21.15.136:0/3179455011 learned_addr learned my addr 172.21.15.136:0/3179455011 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4feea00640 1 -- 172.21.15.136:0/3179455011 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241274909 0 0) 0x7f4ff00cc0a0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.361+0000 7f4feea00640 1 -- 172.21.15.136:0/3179455011 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd4003520 con 0x7f4ff00cffd0 2024-05-04T07:51:47.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.362+0000 7f4fef400640 1 -- 172.21.15.136:0/3179455011 >> v1:172.21.15.142:6789/0 conn(0x7f4ff0160340 legacy=0x7f4ff00cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:47.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.362+0000 7f4fef400640 1 -- 172.21.15.136:0/3179455011 >> v1:172.21.15.136:6789/0 conn(0x7f4ff00cffd0 legacy=0x7f4ff00cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.362+0000 7f4fef400640 1 -- 172.21.15.136:0/3179455011 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff00cf7d0 con 0x7f4ff015fa20 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4fef400640 1 --2- 172.21.15.136:0/3179455011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff015fa20 0x7f4ff015fe00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00097a0 tx=0x7f4fe002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac1f5a1bcf8386 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4feea00640 1 -- 172.21.15.136:0/3179455011 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0037070 con 0x7f4ff015fa20 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4feea00640 1 -- 172.21.15.136:0/3179455011 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0032440 con 0x7f4ff015fa20 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4feea00640 1 -- 172.21.15.136:0/3179455011 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0032810 con 0x7f4ff015fa20 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4ff6200640 1 -- 172.21.15.136:0/3179455011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff015fa20 msgr2=0x7f4ff015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.363+0000 7f4ff6200640 1 --2- 172.21.15.136:0/3179455011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff015fa20 0x7f4ff015fe00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00097a0 tx=0x7f4fe002a180 comp rx=0 tx=0).stop 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.364+0000 7f4ff6200640 1 -- 172.21.15.136:0/3179455011 shutdown_connections 2024-05-04T07:51:47.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.364+0000 7f4ff6200640 1 --2- 172.21.15.136:0/3179455011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff015fa20 0x7f4ff015fe00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.364+0000 7f4ff6200640 1 -- 172.21.15.136:0/3179455011 >> 172.21.15.136:0/3179455011 conn(0x7f4ff00d0c30 msgr2=0x7f4ff00d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:47.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.364+0000 7f4ff6200640 1 -- 172.21.15.136:0/3179455011 shutdown_connections 2024-05-04T07:51:47.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.364+0000 7f4ff6200640 1 -- 172.21.15.136:0/3179455011 wait complete. 2024-05-04T07:51:47.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.365+0000 7f4ff6200640 1 Processor -- start 2024-05-04T07:51:47.367 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.366+0000 7f4ff6200640 1 -- start start 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.366+0000 7f4ff6200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4ff6200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff015fa20 0x7f4ff01f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4ff6200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff0160340 0x7f4ff006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4ff6200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0144f70 con 0x7f4ff00cffd0 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4ff6200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff00cf1c0 con 0x7f4ff015fa20 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4ff6200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff01457d0 con 0x7f4ff0160340 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53984/0 (socket says 172.21.15.136:53984) 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 -- 172.21.15.136:0/4228065945 learned_addr learned my addr 172.21.15.136:0/4228065945 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fe7e00640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff015fa20 0x7f4ff01f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 -- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff0160340 msgr2=0x7f4ff006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff0160340 0x7f4ff006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 -- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff015fa20 msgr2=0x7f4ff01f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff015fa20 0x7f4ff01f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.367+0000 7f4fef400640 1 -- 172.21.15.136:0/4228065945 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff006f780 con 0x7f4ff00cffd0 2024-05-04T07:51:47.370 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4fef400640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00098c0 tx=0x7f4fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0037040 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0042070 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff00c8ed0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0030940 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.368+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff006efb0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.369+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0069400 con 0x7f4ff00cffd0 2024-05-04T07:51:47.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.370+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fe0030ae0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.372+0000 7f4fe7400640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 0x7f4fcc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.372+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4fe00b80e0 con 0x7f4ff00cffd0 2024-05-04T07:51:47.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.372+0000 7f4fe7e00640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 0x7f4fcc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.373+0000 7f4fe7e00640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 0x7f4fcc078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00cfd60 tx=0x7f4fd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.379 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.377+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fe0081810 con 0x7f4ff00cffd0 2024-05-04T07:51:47.623 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.621+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff00d0900 con 0x7f4ff00cffd0 2024-05-04T07:51:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.622+0000 7f4fe7400640 1 -- 172.21.15.136:0/4228065945 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7f4fe0081110 con 0x7f4ff00cffd0 2024-05-04T07:51:47.624 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:47.624 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:51:47.624 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:51:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.624+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 msgr2=0x7f4fcc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.626 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.624+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 0x7f4fcc078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00cfd60 tx=0x7f4fd8008040 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 msgr2=0x7f4ff01f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4fe00098c0 tx=0x7f4fe00046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 shutdown_connections 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4fcc0762d0 0x7f4fcc078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ff0160340 0x7f4ff006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ff015fa20 0x7f4ff01f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 --2- 172.21.15.136:0/4228065945 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ff00cffd0 0x7f4ff01f8cc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 >> 172.21.15.136:0/4228065945 conn(0x7f4ff00d0c30 msgr2=0x7f4ff00b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 shutdown_connections 2024-05-04T07:51:47.627 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.625+0000 7f4ff6200640 1 -- 172.21.15.136:0/4228065945 wait complete. 2024-05-04T07:51:47.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:51:47.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.837+0000 7f8568600640 1 Processor -- start 2024-05-04T07:51:47.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.837+0000 7f8568600640 1 -- start start 2024-05-04T07:51:47.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.838+0000 7f8568600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85600cc6f0 0x7f85600cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.838+0000 7f8568600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 0x7f85600cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.838+0000 7f8568600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856015f570 con 0x7f856015f190 2024-05-04T07:51:47.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.838+0000 7f8568600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f85600c6940 con 0x7f85600cc6f0 2024-05-04T07:51:47.840 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.838+0000 7f8568600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f85600ccb80 con 0x7f85600cf960 2024-05-04T07:51:47.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.839+0000 7f8565200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85600cc6f0 0x7f85600cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.839+0000 7f8565200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f85600cc6f0 0x7f85600cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:56248/0 (socket says 172.21.15.136:56248) 2024-05-04T07:51:47.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.839+0000 7f8565200640 1 -- 172.21.15.136:0/3533039716 learned_addr learned my addr 172.21.15.136:0/3533039716 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:47.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.839+0000 7f8566600640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 0x7f85600cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.840+0000 7f8565200640 1 -- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 msgr2=0x7f85600cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:47.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.840+0000 7f8565200640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 0x7f85600cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.840+0000 7f8565200640 1 -- 172.21.15.136:0/3533039716 >> v1:172.21.15.142:6789/0 conn(0x7f856015f190 legacy=0x7f85600ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.840+0000 7f8565200640 1 -- 172.21.15.136:0/3533039716 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85600c6010 con 0x7f85600cc6f0 2024-05-04T07:51:47.842 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.840+0000 7f8566600640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 0x7f85600cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:51:47.843 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.842+0000 7f8565200640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600cc6f0 0x7f85600cb6d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f854c009870 tx=0x7f854c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144415ed32e73598 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.842+0000 7f855fe00640 1 -- 172.21.15.136:0/3533039716 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c037070 con 0x7f85600cc6f0 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.842+0000 7f855fe00640 1 -- 172.21.15.136:0/3533039716 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c032440 con 0x7f85600cc6f0 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.842+0000 7f855fe00640 1 -- 172.21.15.136:0/3533039716 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c032810 con 0x7f85600cc6f0 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 -- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600cc6f0 msgr2=0x7f85600cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600cc6f0 0x7f85600cb6d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f854c009870 tx=0x7f854c02a250 comp rx=0 tx=0).stop 2024-05-04T07:51:47.846 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 -- 172.21.15.136:0/3533039716 shutdown_connections 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85600cf960 0x7f85600cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 --2- 172.21.15.136:0/3533039716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85600cc6f0 0x7f85600cb6d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 -- 172.21.15.136:0/3533039716 >> 172.21.15.136:0/3533039716 conn(0x7f85600d0c30 msgr2=0x7f85600d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 -- 172.21.15.136:0/3533039716 shutdown_connections 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.843+0000 7f8568600640 1 -- 172.21.15.136:0/3533039716 wait complete. 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.845+0000 7f8568600640 1 Processor -- start 2024-05-04T07:51:47.847 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.845+0000 7f8568600640 1 -- start start 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.845+0000 7f8568600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8568600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856015f190 0x7f856015de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8568600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856015e380 0x7f8560161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8568600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f85600cf300 con 0x7f85600cf960 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8568600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f85600c65d0 con 0x7f856015e380 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8568600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f85600cf480 con 0x7f856015f190 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53988/0 (socket says 172.21.15.136:53988) 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 -- 172.21.15.136:0/3584607037 learned_addr learned my addr 172.21.15.136:0/3584607037 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:47.849 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8566600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856015e380 0x7f8560161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565200640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856015f190 0x7f856015de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 -- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856015f190 msgr2=0x7f856015de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856015f190 0x7f856015de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 -- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856015e380 msgr2=0x7f8560161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856015e380 0x7f8560161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.846+0000 7f8565c00640 1 -- 172.21.15.136:0/3584607037 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85601622f0 con 0x7f85600cf960 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f8565c00640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f855400c3d0 tx=0x7f855400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554017070 con 0x7f85600cf960 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85540052d0 con 0x7f85600cf960 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554003830 con 0x7f85600cf960 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85600ae910 con 0x7f85600cf960 2024-05-04T07:51:47.850 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.847+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85600aeed0 con 0x7f85600cf960 2024-05-04T07:51:47.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.848+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8560069400 con 0x7f85600cf960 2024-05-04T07:51:47.851 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.849+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f855401a070 con 0x7f85600cf960 2024-05-04T07:51:47.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.850+0000 7f855d600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 0x7f8540078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:47.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.851+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8554096a90 con 0x7f85600cf960 2024-05-04T07:51:47.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.851+0000 7f8565200640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 0x7f8540078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:47.852 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.851+0000 7f8565200640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 0x7f8540078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f854c034000 tx=0x7f854c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:47.856 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:47.855+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f856015f570 con 0x7f85600cf960 2024-05-04T07:51:48.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.060+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f856015e790 con 0x7f85600cf960 2024-05-04T07:51:48.063 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.062+0000 7f855d600640 1 -- 172.21.15.136:0/3584607037 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17002 (secure 0 0 0) 0x7f8554096090 con 0x7f85600cf960 2024-05-04T07:51:48.064 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:48.064 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":39,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:51:45.099523+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:51:41.545546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-04T07:51:42.525458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:51:48.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.064+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 msgr2=0x7f8540078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.064+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 0x7f8540078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f854c034000 tx=0x7f854c02e000 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.064+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 msgr2=0x7f85600b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.064+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f855400c3d0 tx=0x7f855400c890 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 shutdown_connections 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f85400762d0 0x7f8540078790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f856015e380 0x7f8560161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f856015f190 0x7f856015de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 --2- 172.21.15.136:0/3584607037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85600cf960 0x7f85600b12f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 >> 172.21.15.136:0/3584607037 conn(0x7f85600d0c30 msgr2=0x7f85600ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 shutdown_connections 2024-05-04T07:51:48.067 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.065+0000 7f8568600640 1 -- 172.21.15.136:0/3584607037 wait complete. 2024-05-04T07:51:48.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T07:51:48.085 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:51:48.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.280+0000 7f7307200640 1 Processor -- start 2024-05-04T07:51:48.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.280+0000 7f7307200640 1 -- start start 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.281+0000 7f7307200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080afc80 0x7f73080cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.281+0000 7f7307200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73080ce8d0 0x7f7308071d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.281+0000 7f7307200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7308072290 con 0x7f730806f220 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.281+0000 7f7307200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f73080d1840 con 0x7f73080ce8d0 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.281+0000 7f7307200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f73080cee00 con 0x7f73080afc80 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73080ce8d0 0x7f7308071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f73080ce8d0 0x7f7308071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54004/0 (socket says 172.21.15.136:54004) 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 -- 172.21.15.136:0/2161895006 learned_addr learned my addr 172.21.15.136:0/2161895006 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f7305e00640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080afc80 0x7f73080cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 -- 172.21.15.136:0/2161895006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080afc80 msgr2=0x7f73080cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080afc80 0x7f73080cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 -- 172.21.15.136:0/2161895006 >> v1:172.21.15.142:6789/0 conn(0x7f730806f220 legacy=0x7f73080b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:48.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.282+0000 7f72ffe00640 1 -- 172.21.15.136:0/2161895006 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73080cf0e0 con 0x7f73080ce8d0 2024-05-04T07:51:48.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.284+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73080ce8d0 0x7f7308071d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009870 tx=0x7f72f002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ce09fda6ae5411 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.285+0000 7f7305400640 1 -- 172.21.15.136:0/2161895006 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0037070 con 0x7f73080ce8d0 2024-05-04T07:51:48.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.285+0000 7f7305400640 1 -- 172.21.15.136:0/2161895006 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0032440 con 0x7f73080ce8d0 2024-05-04T07:51:48.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.285+0000 7f7305400640 1 -- 172.21.15.136:0/2161895006 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0032810 con 0x7f73080ce8d0 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.285+0000 7f7307200640 1 -- 172.21.15.136:0/2161895006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73080ce8d0 msgr2=0x7f7308071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.285+0000 7f7307200640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73080ce8d0 0x7f7308071d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009870 tx=0x7f72f002a1c0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 -- 172.21.15.136:0/2161895006 shutdown_connections 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73080ce8d0 0x7f7308071d50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 --2- 172.21.15.136:0/2161895006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080afc80 0x7f73080cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 -- 172.21.15.136:0/2161895006 >> 172.21.15.136:0/2161895006 conn(0x7f73080d09d0 msgr2=0x7f73080d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 -- 172.21.15.136:0/2161895006 shutdown_connections 2024-05-04T07:51:48.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.286+0000 7f7307200640 1 -- 172.21.15.136:0/2161895006 wait complete. 2024-05-04T07:51:48.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.287+0000 7f7307200640 1 Processor -- start 2024-05-04T07:51:48.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 -- start start 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 0x7f730815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 0x7f730815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f73080cf980 con 0x7f730806f220 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f73080cf6a0 con 0x7f73080afc80 2024-05-04T07:51:48.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.288+0000 7f7307200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f73080b0060 con 0x7f73080ce8d0 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54008/0 (socket says 172.21.15.136:54008) 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 -- 172.21.15.136:0/2729937131 learned_addr learned my addr 172.21.15.136:0/2729937131 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 0x7f730815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7306800640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 0x7f730815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 -- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 msgr2=0x7f730815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 0x7f730815eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 -- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 msgr2=0x7f730815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 0x7f730815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7305e00640 1 -- 172.21.15.136:0/2729937131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730814c360 con 0x7f730806f220 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f7306800640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 0x7f730815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:51:48.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.289+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 0x7f730815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f7305e00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72f800d620 tx=0x7f72f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800b620 con 0x7f730806f220 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8019070 con 0x7f730806f220 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73080c8ef0 con 0x7f730806f220 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800ba00 con 0x7f730806f220 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.290+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73080c94b0 con 0x7f730806f220 2024-05-04T07:51:48.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.291+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7308069400 con 0x7f730806f220 2024-05-04T07:51:48.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.292+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f72f800bba0 con 0x7f730806f220 2024-05-04T07:51:48.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.293+0000 7f72fe000640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 0x7f72e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.294+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f72f8097c80 con 0x7f730806f220 2024-05-04T07:51:48.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.294+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 0x7f72e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.294+0000 7f72ffe00640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 0x7f72e4078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72f0034000 tx=0x7f72f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.298+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f730814c360 con 0x7f730806f220 2024-05-04T07:51:48.501 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.499+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f730815bea0 con 0x7f72e40762d0 2024-05-04T07:51:48.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.509+0000 7f72fe000640 1 -- 172.21.15.136:0/2729937131 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251877 (secure 0 0 0) 0x7f730815bea0 con 0x7f72e40762d0 2024-05-04T07:51:48.515 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:48.516 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:51:48.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.515+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 msgr2=0x7f72e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.515+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 0x7f72e4078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72f0034000 tx=0x7f72f002e000 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.515+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 msgr2=0x7f730814be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.515+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72f800d620 tx=0x7f72f800dae0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.515+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 shutdown_connections 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f72e40762d0 0x7f72e4078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73080ce8d0 0x7f730815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73080afc80 0x7f730815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 --2- 172.21.15.136:0/2729937131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730806f220 0x7f730814be20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 >> 172.21.15.136:0/2729937131 conn(0x7f73080d09d0 msgr2=0x7f73080b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 shutdown_connections 2024-05-04T07:51:48.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.516+0000 7f7307200640 1 -- 172.21.15.136:0/2729937131 wait complete. 2024-05-04T07:51:48.535 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-05-04T07:51:47.297875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4608000,"data_stored":2644207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.239450"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136662+0000","last_change":"2024-05-04T07:51:44.118898+0000","last_active":"2024-05-04T07:51:44.136662+0000","last_peered":"2024-05-04T07:51:44.136662+0000","last_clean":"2024-05-04T07:51:44.136662+0000","last_became_active":"2024-05-04T07:51:44.118604+0000","last_became_peered":"2024-05-04T07:51:44.118604+0000","last_unstale":"2024-05-04T07:51:44.136662+0000","last_undegraded":"2024-05-04T07:51:44.136662+0000","last_fullsized":"2024-05-04T07:51:44.136662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124882+0000","last_change":"2024-05-04T07:51:44.116773+0000","last_active":"2024-05-04T07:51:44.124882+0000","last_peered":"2024-05-04T07:51:44.124882+0000","last_clean":"2024-05-04T07:51:44.124882+0000","last_became_active":"2024-05-04T07:51:44.116282+0000","last_became_peered":"2024-05-04T07:51:44.116282+0000","last_unstale":"2024-05-04T07:51:44.124882+0000","last_undegraded":"2024-05-04T07:51:44.124882+0000","last_fullsized":"2024-05-04T07:51:44.124882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133346+0000","last_change":"2024-05-04T07:51:44.125538+0000","last_active":"2024-05-04T07:51:44.133346+0000","last_peered":"2024-05-04T07:51:44.133346+0000","last_clean":"2024-05-04T07:51:44.133346+0000","last_became_active":"2024-05-04T07:51:44.124353+0000","last_became_peered":"2024-05-04T07:51:44.124353+0000","last_unstale":"2024-05-04T07:51:44.133346+0000","last_undegraded":"2024-05-04T07:51:44.133346+0000","last_fullsized":"2024-05-04T07:51:44.133346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.120320+0000","last_change":"2024-05-04T07:51:44.115300+0000","last_active":"2024-05-04T07:51:44.120320+0000","last_peered":"2024-05-04T07:51:44.120320+0000","last_clean":"2024-05-04T07:51:44.120320+0000","last_became_active":"2024-05-04T07:51:44.114668+0000","last_became_peered":"2024-05-04T07:51:44.114668+0000","last_unstale":"2024-05-04T07:51:44.120320+0000","last_undegraded":"2024-05-04T07:51:44.120320+0000","last_fullsized":"2024-05-04T07:51:44.120320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:37.859798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133257+0000","last_change":"2024-05-04T07:51:44.127995+0000","last_active":"2024-05-04T07:51:44.133257+0000","last_peered":"2024-05-04T07:51:44.133257+0000","last_clean":"2024-05-04T07:51:44.133257+0000","last_became_active":"2024-05-04T07:51:44.127666+0000","last_became_peered":"2024-05-04T07:51:44.127666+0000","last_unstale":"2024-05-04T07:51:44.133257+0000","last_undegraded":"2024-05-04T07:51:44.133257+0000","last_fullsized":"2024-05-04T07:51:44.133257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:53:09.175880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132617+0000","last_change":"2024-05-04T07:51:44.127956+0000","last_active":"2024-05-04T07:51:44.132617+0000","last_peered":"2024-05-04T07:51:44.132617+0000","last_clean":"2024-05-04T07:51:44.132617+0000","last_became_active":"2024-05-04T07:51:44.127640+0000","last_became_peered":"2024-05-04T07:51:44.127640+0000","last_unstale":"2024-05-04T07:51:44.132617+0000","last_undegraded":"2024-05-04T07:51:44.132617+0000","last_fullsized":"2024-05-04T07:51:44.132617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137006+0000","last_change":"2024-05-04T07:51:44.132403+0000","last_active":"2024-05-04T07:51:44.137006+0000","last_peered":"2024-05-04T07:51:44.137006+0000","last_clean":"2024-05-04T07:51:44.137006+0000","last_became_active":"2024-05-04T07:51:44.132117+0000","last_became_peered":"2024-05-04T07:51:44.132117+0000","last_unstale":"2024-05-04T07:51:44.137006+0000","last_undegraded":"2024-05-04T07:51:44.137006+0000","last_fullsized":"2024-05-04T07:51:44.137006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:42:15.806425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121430+0000","last_change":"2024-05-04T07:51:44.116339+0000","last_active":"2024-05-04T07:51:44.121430+0000","last_peered":"2024-05-04T07:51:44.121430+0000","last_clean":"2024-05-04T07:51:44.121430+0000","last_became_active":"2024-05-04T07:51:44.116023+0000","last_became_peered":"2024-05-04T07:51:44.116023+0000","last_unstale":"2024-05-04T07:51:44.121430+0000","last_undegraded":"2024-05-04T07:51:44.121430+0000","last_fullsized":"2024-05-04T07:51:44.121430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.143560+0000","last_change":"2024-05-04T07:51:44.134816+0000","last_active":"2024-05-04T07:51:44.143560+0000","last_peered":"2024-05-04T07:51:44.143560+0000","last_clean":"2024-05-04T07:51:44.143560+0000","last_became_active":"2024-05-04T07:51:44.134262+0000","last_became_peered":"2024-05-04T07:51:44.134262+0000","last_unstale":"2024-05-04T07:51:44.143560+0000","last_undegraded":"2024-05-04T07:51:44.143560+0000","last_fullsized":"2024-05-04T07:51:44.143560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134605+0000","last_change":"2024-05-04T07:51:44.125667+0000","last_active":"2024-05-04T07:51:44.134605+0000","last_peered":"2024-05-04T07:51:44.134605+0000","last_clean":"2024-05-04T07:51:44.134605+0000","last_became_active":"2024-05-04T07:51:44.125385+0000","last_became_peered":"2024-05-04T07:51:44.125385+0000","last_unstale":"2024-05-04T07:51:44.134605+0000","last_undegraded":"2024-05-04T07:51:44.134605+0000","last_fullsized":"2024-05-04T07:51:44.134605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134645+0000","last_change":"2024-05-04T07:51:44.126496+0000","last_active":"2024-05-04T07:51:44.134645+0000","last_peered":"2024-05-04T07:51:44.134645+0000","last_clean":"2024-05-04T07:51:44.134645+0000","last_became_active":"2024-05-04T07:51:44.125342+0000","last_became_peered":"2024-05-04T07:51:44.125342+0000","last_unstale":"2024-05-04T07:51:44.134645+0000","last_undegraded":"2024-05-04T07:51:44.134645+0000","last_fullsized":"2024-05-04T07:51:44.134645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133795+0000","last_change":"2024-05-04T07:51:44.125532+0000","last_active":"2024-05-04T07:51:44.133795+0000","last_peered":"2024-05-04T07:51:44.133795+0000","last_clean":"2024-05-04T07:51:44.133795+0000","last_became_active":"2024-05-04T07:51:44.124452+0000","last_became_peered":"2024-05-04T07:51:44.124452+0000","last_unstale":"2024-05-04T07:51:44.133795+0000","last_undegraded":"2024-05-04T07:51:44.133795+0000","last_fullsized":"2024-05-04T07:51:44.133795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.131792+0000","last_change":"2024-05-04T07:51:44.124027+0000","last_active":"2024-05-04T07:51:44.131792+0000","last_peered":"2024-05-04T07:51:44.131792+0000","last_clean":"2024-05-04T07:51:44.131792+0000","last_became_active":"2024-05-04T07:51:44.123683+0000","last_became_peered":"2024-05-04T07:51:44.123683+0000","last_unstale":"2024-05-04T07:51:44.131792+0000","last_undegraded":"2024-05-04T07:51:44.131792+0000","last_fullsized":"2024-05-04T07:51:44.131792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130818+0000","last_change":"2024-05-04T07:51:44.121354+0000","last_active":"2024-05-04T07:51:44.130818+0000","last_peered":"2024-05-04T07:51:44.130818+0000","last_clean":"2024-05-04T07:51:44.130818+0000","last_became_active":"2024-05-04T07:51:44.121003+0000","last_became_peered":"2024-05-04T07:51:44.121003+0000","last_unstale":"2024-05-04T07:51:44.130818+0000","last_undegraded":"2024-05-04T07:51:44.130818+0000","last_fullsized":"2024-05-04T07:51:44.130818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.131273+0000","last_change":"2024-05-04T07:51:44.119323+0000","last_active":"2024-05-04T07:51:44.131273+0000","last_peered":"2024-05-04T07:51:44.131273+0000","last_clean":"2024-05-04T07:51:44.131273+0000","last_became_active":"2024-05-04T07:51:44.119035+0000","last_became_peered":"2024-05-04T07:51:44.119035+0000","last_unstale":"2024-05-04T07:51:44.131273+0000","last_undegraded":"2024-05-04T07:51:44.131273+0000","last_fullsized":"2024-05-04T07:51:44.131273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.125534+0000","last_change":"2024-05-04T07:51:44.120713+0000","last_active":"2024-05-04T07:51:44.125534+0000","last_peered":"2024-05-04T07:51:44.125534+0000","last_clean":"2024-05-04T07:51:44.125534+0000","last_became_active":"2024-05-04T07:51:44.120193+0000","last_became_peered":"2024-05-04T07:51:44.120193+0000","last_unstale":"2024-05-04T07:51:44.125534+0000","last_undegraded":"2024-05-04T07:51:44.125534+0000","last_fullsized":"2024-05-04T07:51:44.125534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124803+0000","last_change":"2024-05-04T07:51:44.120654+0000","last_active":"2024-05-04T07:51:44.124803+0000","last_peered":"2024-05-04T07:51:44.124803+0000","last_clean":"2024-05-04T07:51:44.124803+0000","last_became_active":"2024-05-04T07:51:44.120314+0000","last_became_peered":"2024-05-04T07:51:44.120314+0000","last_unstale":"2024-05-04T07:51:44.124803+0000","last_undegraded":"2024-05-04T07:51:44.124803+0000","last_fullsized":"2024-05-04T07:51:44.124803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134080+0000","last_change":"2024-05-04T07:51:44.126867+0000","last_active":"2024-05-04T07:51:44.134080+0000","last_peered":"2024-05-04T07:51:44.134080+0000","last_clean":"2024-05-04T07:51:44.134080+0000","last_became_active":"2024-05-04T07:51:44.125396+0000","last_became_peered":"2024-05-04T07:51:44.125396+0000","last_unstale":"2024-05-04T07:51:44.134080+0000","last_undegraded":"2024-05-04T07:51:44.134080+0000","last_fullsized":"2024-05-04T07:51:44.134080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.119642+0000","last_change":"2024-05-04T07:51:44.106695+0000","last_active":"2024-05-04T07:51:44.119642+0000","last_peered":"2024-05-04T07:51:44.119642+0000","last_clean":"2024-05-04T07:51:44.119642+0000","last_became_active":"2024-05-04T07:51:44.106382+0000","last_became_peered":"2024-05-04T07:51:44.106382+0000","last_unstale":"2024-05-04T07:51:44.119642+0000","last_undegraded":"2024-05-04T07:51:44.119642+0000","last_fullsized":"2024-05-04T07:51:44.119642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:58.149048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121302+0000","last_change":"2024-05-04T07:51:44.116295+0000","last_active":"2024-05-04T07:51:44.121302+0000","last_peered":"2024-05-04T07:51:44.121302+0000","last_clean":"2024-05-04T07:51:44.121302+0000","last_became_active":"2024-05-04T07:51:44.115473+0000","last_became_peered":"2024-05-04T07:51:44.115473+0000","last_unstale":"2024-05-04T07:51:44.121302+0000","last_undegraded":"2024-05-04T07:51:44.121302+0000","last_fullsized":"2024-05-04T07:51:44.121302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136967+0000","last_change":"2024-05-04T07:51:44.131233+0000","last_active":"2024-05-04T07:51:44.136967+0000","last_peered":"2024-05-04T07:51:44.136967+0000","last_clean":"2024-05-04T07:51:44.136967+0000","last_became_active":"2024-05-04T07:51:44.130885+0000","last_became_peered":"2024-05-04T07:51:44.130885+0000","last_unstale":"2024-05-04T07:51:44.136967+0000","last_undegraded":"2024-05-04T07:51:44.136967+0000","last_fullsized":"2024-05-04T07:51:44.136967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:54:17.379215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127498+0000","last_change":"2024-05-04T07:51:44.120115+0000","last_active":"2024-05-04T07:51:44.127498+0000","last_peered":"2024-05-04T07:51:44.127498+0000","last_clean":"2024-05-04T07:51:44.127498+0000","last_became_active":"2024-05-04T07:51:44.116894+0000","last_became_peered":"2024-05-04T07:51:44.116894+0000","last_unstale":"2024-05-04T07:51:44.127498+0000","last_undegraded":"2024-05-04T07:51:44.127498+0000","last_fullsized":"2024-05-04T07:51:44.127498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.103335+0000","last_change":"2024-05-04T07:51:44.099431+0000","last_active":"2024-05-04T07:51:44.103335+0000","last_peered":"2024-05-04T07:51:44.103335+0000","last_clean":"2024-05-04T07:51:44.103335+0000","last_became_active":"2024-05-04T07:51:44.098134+0000","last_became_peered":"2024-05-04T07:51:44.098134+0000","last_unstale":"2024-05-04T07:51:44.103335+0000","last_undegraded":"2024-05-04T07:51:44.103335+0000","last_fullsized":"2024-05-04T07:51:44.103335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105807+0000","last_change":"2024-05-04T07:51:44.100925+0000","last_active":"2024-05-04T07:51:44.105807+0000","last_peered":"2024-05-04T07:51:44.105807+0000","last_clean":"2024-05-04T07:51:44.105807+0000","last_became_active":"2024-05-04T07:51:44.100199+0000","last_became_peered":"2024-05-04T07:51:44.100199+0000","last_unstale":"2024-05-04T07:51:44.105807+0000","last_undegraded":"2024-05-04T07:51:44.105807+0000","last_fullsized":"2024-05-04T07:51:44.105807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:46.910228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121522+0000","last_change":"2024-05-04T07:51:44.117620+0000","last_active":"2024-05-04T07:51:44.121522+0000","last_peered":"2024-05-04T07:51:44.121522+0000","last_clean":"2024-05-04T07:51:44.121522+0000","last_became_active":"2024-05-04T07:51:44.117288+0000","last_became_peered":"2024-05-04T07:51:44.117288+0000","last_unstale":"2024-05-04T07:51:44.121522+0000","last_undegraded":"2024-05-04T07:51:44.121522+0000","last_fullsized":"2024-05-04T07:51:44.121522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124270+0000","last_change":"2024-05-04T07:51:44.118318+0000","last_active":"2024-05-04T07:51:44.124270+0000","last_peered":"2024-05-04T07:51:44.124270+0000","last_clean":"2024-05-04T07:51:44.124270+0000","last_became_active":"2024-05-04T07:51:44.118030+0000","last_became_peered":"2024-05-04T07:51:44.118030+0000","last_unstale":"2024-05-04T07:51:44.124270+0000","last_undegraded":"2024-05-04T07:51:44.124270+0000","last_fullsized":"2024-05-04T07:51:44.124270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.112105+0000","last_change":"2024-05-04T07:51:44.108334+0000","last_active":"2024-05-04T07:51:44.112105+0000","last_peered":"2024-05-04T07:51:44.112105+0000","last_clean":"2024-05-04T07:51:44.112105+0000","last_became_active":"2024-05-04T07:51:44.107321+0000","last_became_peered":"2024-05-04T07:51:44.107321+0000","last_unstale":"2024-05-04T07:51:44.112105+0000","last_undegraded":"2024-05-04T07:51:44.112105+0000","last_fullsized":"2024-05-04T07:51:44.112105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:16.186704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137047+0000","last_change":"2024-05-04T07:51:44.132446+0000","last_active":"2024-05-04T07:51:44.137047+0000","last_peered":"2024-05-04T07:51:44.137047+0000","last_clean":"2024-05-04T07:51:44.137047+0000","last_became_active":"2024-05-04T07:51:44.132149+0000","last_became_peered":"2024-05-04T07:51:44.132149+0000","last_unstale":"2024-05-04T07:51:44.137047+0000","last_undegraded":"2024-05-04T07:51:44.137047+0000","last_fullsized":"2024-05-04T07:51:44.137047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:02:21.231469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.112971+0000","last_change":"2024-05-04T07:51:44.109682+0000","last_active":"2024-05-04T07:51:44.112971+0000","last_peered":"2024-05-04T07:51:44.112971+0000","last_clean":"2024-05-04T07:51:44.112971+0000","last_became_active":"2024-05-04T07:51:44.109391+0000","last_became_peered":"2024-05-04T07:51:44.109391+0000","last_unstale":"2024-05-04T07:51:44.112971+0000","last_undegraded":"2024-05-04T07:51:44.112971+0000","last_fullsized":"2024-05-04T07:51:44.112971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:45.484062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121580+0000","last_change":"2024-05-04T07:51:44.117869+0000","last_active":"2024-05-04T07:51:44.121580+0000","last_peered":"2024-05-04T07:51:44.121580+0000","last_clean":"2024-05-04T07:51:44.121580+0000","last_became_active":"2024-05-04T07:51:44.117524+0000","last_became_peered":"2024-05-04T07:51:44.117524+0000","last_unstale":"2024-05-04T07:51:44.121580+0000","last_undegraded":"2024-05-04T07:51:44.121580+0000","last_fullsized":"2024-05-04T07:51:44.121580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.103280+0000","last_change":"2024-05-04T07:51:44.099234+0000","last_active":"2024-05-04T07:51:44.103280+0000","last_peered":"2024-05-04T07:51:44.103280+0000","last_clean":"2024-05-04T07:51:44.103280+0000","last_became_active":"2024-05-04T07:51:44.098157+0000","last_became_peered":"2024-05-04T07:51:44.098157+0000","last_unstale":"2024-05-04T07:51:44.103280+0000","last_undegraded":"2024-05-04T07:51:44.103280+0000","last_fullsized":"2024-05-04T07:51:44.103280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132846+0000","last_change":"2024-05-04T07:51:44.127320+0000","last_active":"2024-05-04T07:51:44.132846+0000","last_peered":"2024-05-04T07:51:44.132846+0000","last_clean":"2024-05-04T07:51:44.132846+0000","last_became_active":"2024-05-04T07:51:44.127089+0000","last_became_peered":"2024-05-04T07:51:44.127089+0000","last_unstale":"2024-05-04T07:51:44.132846+0000","last_undegraded":"2024-05-04T07:51:44.132846+0000","last_fullsized":"2024-05-04T07:51:44.132846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.125717+0000","last_change":"2024-05-04T07:51:44.120683+0000","last_active":"2024-05-04T07:51:44.125717+0000","last_peered":"2024-05-04T07:51:44.125717+0000","last_clean":"2024-05-04T07:51:44.125717+0000","last_became_active":"2024-05-04T07:51:44.120276+0000","last_became_peered":"2024-05-04T07:51:44.120276+0000","last_unstale":"2024-05-04T07:51:44.125717+0000","last_undegraded":"2024-05-04T07:51:44.125717+0000","last_fullsized":"2024-05-04T07:51:44.125717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.142808+0000","last_change":"2024-05-04T07:51:43.105658+0000","last_active":"2024-05-04T07:51:44.142808+0000","last_peered":"2024-05-04T07:51:44.142808+0000","last_clean":"2024-05-04T07:51:44.142808+0000","last_became_active":"2024-05-04T07:51:43.105343+0000","last_became_peered":"2024-05-04T07:51:43.105343+0000","last_unstale":"2024-05-04T07:51:44.142808+0000","last_undegraded":"2024-05-04T07:51:44.142808+0000","last_fullsized":"2024-05-04T07:51:44.142808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124477+0000","last_change":"2024-05-04T07:51:44.121029+0000","last_active":"2024-05-04T07:51:44.124477+0000","last_peered":"2024-05-04T07:51:44.124477+0000","last_clean":"2024-05-04T07:51:44.124477+0000","last_became_active":"2024-05-04T07:51:44.120740+0000","last_became_peered":"2024-05-04T07:51:44.120740+0000","last_unstale":"2024-05-04T07:51:44.124477+0000","last_undegraded":"2024-05-04T07:51:44.124477+0000","last_fullsized":"2024-05-04T07:51:44.124477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.142901+0000","last_change":"2024-05-04T07:51:43.116177+0000","last_active":"2024-05-04T07:51:44.142901+0000","last_peered":"2024-05-04T07:51:44.142901+0000","last_clean":"2024-05-04T07:51:44.142901+0000","last_became_active":"2024-05-04T07:51:43.115966+0000","last_became_peered":"2024-05-04T07:51:43.115966+0000","last_unstale":"2024-05-04T07:51:44.142901+0000","last_undegraded":"2024-05-04T07:51:44.142901+0000","last_fullsized":"2024-05-04T07:51:44.142901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:15.172789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127461+0000","last_change":"2024-05-04T07:51:44.116837+0000","last_active":"2024-05-04T07:51:44.127461+0000","last_peered":"2024-05-04T07:51:44.127461+0000","last_clean":"2024-05-04T07:51:44.127461+0000","last_became_active":"2024-05-04T07:51:44.116549+0000","last_became_peered":"2024-05-04T07:51:44.116549+0000","last_unstale":"2024-05-04T07:51:44.127461+0000","last_undegraded":"2024-05-04T07:51:44.127461+0000","last_fullsized":"2024-05-04T07:51:44.127461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:45.484062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135428+0000","last_change":"2024-05-04T07:51:43.109578+0000","last_active":"2024-05-04T07:51:44.135428+0000","last_peered":"2024-05-04T07:51:44.135428+0000","last_clean":"2024-05-04T07:51:44.135428+0000","last_became_active":"2024-05-04T07:51:43.109308+0000","last_became_peered":"2024-05-04T07:51:43.109308+0000","last_unstale":"2024-05-04T07:51:44.135428+0000","last_undegraded":"2024-05-04T07:51:44.135428+0000","last_fullsized":"2024-05-04T07:51:44.135428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141880+0000","last_change":"2024-05-04T07:51:44.136759+0000","last_active":"2024-05-04T07:51:44.141880+0000","last_peered":"2024-05-04T07:51:44.141880+0000","last_clean":"2024-05-04T07:51:44.141880+0000","last_became_active":"2024-05-04T07:51:44.136436+0000","last_became_peered":"2024-05-04T07:51:44.136436+0000","last_unstale":"2024-05-04T07:51:44.141880+0000","last_undegraded":"2024-05-04T07:51:44.141880+0000","last_fullsized":"2024-05-04T07:51:44.141880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:42:15.806425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144908+0000","last_change":"2024-05-04T07:51:43.102993+0000","last_active":"2024-05-04T07:51:44.144908+0000","last_peered":"2024-05-04T07:51:44.144908+0000","last_clean":"2024-05-04T07:51:44.144908+0000","last_became_active":"2024-05-04T07:51:43.102648+0000","last_became_peered":"2024-05-04T07:51:43.102648+0000","last_unstale":"2024-05-04T07:51:44.144908+0000","last_undegraded":"2024-05-04T07:51:44.144908+0000","last_fullsized":"2024-05-04T07:51:44.144908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:20:37.306500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140245+0000","last_change":"2024-05-04T07:51:44.135693+0000","last_active":"2024-05-04T07:51:44.140245+0000","last_peered":"2024-05-04T07:51:44.140245+0000","last_clean":"2024-05-04T07:51:44.140245+0000","last_became_active":"2024-05-04T07:51:44.134002+0000","last_became_peered":"2024-05-04T07:51:44.134002+0000","last_unstale":"2024-05-04T07:51:44.140245+0000","last_undegraded":"2024-05-04T07:51:44.140245+0000","last_fullsized":"2024-05-04T07:51:44.140245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140686+0000","last_change":"2024-05-04T07:51:43.112791+0000","last_active":"2024-05-04T07:51:44.140686+0000","last_peered":"2024-05-04T07:51:44.140686+0000","last_clean":"2024-05-04T07:51:44.140686+0000","last_became_active":"2024-05-04T07:51:43.112508+0000","last_became_peered":"2024-05-04T07:51:43.112508+0000","last_unstale":"2024-05-04T07:51:44.140686+0000","last_undegraded":"2024-05-04T07:51:44.140686+0000","last_fullsized":"2024-05-04T07:51:44.140686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136909+0000","last_change":"2024-05-04T07:51:44.130638+0000","last_active":"2024-05-04T07:51:44.136909+0000","last_peered":"2024-05-04T07:51:44.136909+0000","last_clean":"2024-05-04T07:51:44.136909+0000","last_became_active":"2024-05-04T07:51:44.129894+0000","last_became_peered":"2024-05-04T07:51:44.129894+0000","last_unstale":"2024-05-04T07:51:44.136909+0000","last_undegraded":"2024-05-04T07:51:44.136909+0000","last_fullsized":"2024-05-04T07:51:44.136909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134189+0000","last_change":"2024-05-04T07:51:43.114016+0000","last_active":"2024-05-04T07:51:44.134189+0000","last_peered":"2024-05-04T07:51:44.134189+0000","last_clean":"2024-05-04T07:51:44.134189+0000","last_became_active":"2024-05-04T07:51:43.113690+0000","last_became_peered":"2024-05-04T07:51:43.113690+0000","last_unstale":"2024-05-04T07:51:44.134189+0000","last_undegraded":"2024-05-04T07:51:44.134189+0000","last_fullsized":"2024-05-04T07:51:44.134189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:55.994820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127670+0000","last_change":"2024-05-04T07:51:44.120663+0000","last_active":"2024-05-04T07:51:44.127670+0000","last_peered":"2024-05-04T07:51:44.127670+0000","last_clean":"2024-05-04T07:51:44.127670+0000","last_became_active":"2024-05-04T07:51:44.120217+0000","last_became_peered":"2024-05-04T07:51:44.120217+0000","last_unstale":"2024-05-04T07:51:44.127670+0000","last_undegraded":"2024-05-04T07:51:44.127670+0000","last_fullsized":"2024-05-04T07:51:44.127670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.108367+0000","last_change":"2024-05-04T07:51:43.114078+0000","last_active":"2024-05-04T07:51:44.108367+0000","last_peered":"2024-05-04T07:51:44.108367+0000","last_clean":"2024-05-04T07:51:44.108367+0000","last_became_active":"2024-05-04T07:51:43.113787+0000","last_became_peered":"2024-05-04T07:51:43.113787+0000","last_unstale":"2024-05-04T07:51:44.108367+0000","last_undegraded":"2024-05-04T07:51:44.108367+0000","last_fullsized":"2024-05-04T07:51:44.108367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:10.717165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138660+0000","last_change":"2024-05-04T07:51:44.120890+0000","last_active":"2024-05-04T07:51:44.138660+0000","last_peered":"2024-05-04T07:51:44.138660+0000","last_clean":"2024-05-04T07:51:44.138660+0000","last_became_active":"2024-05-04T07:51:44.120289+0000","last_became_peered":"2024-05-04T07:51:44.120289+0000","last_unstale":"2024-05-04T07:51:44.138660+0000","last_undegraded":"2024-05-04T07:51:44.138660+0000","last_fullsized":"2024-05-04T07:51:44.138660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105570+0000","last_change":"2024-05-04T07:51:43.103674+0000","last_active":"2024-05-04T07:51:44.105570+0000","last_peered":"2024-05-04T07:51:44.105570+0000","last_clean":"2024-05-04T07:51:44.105570+0000","last_became_active":"2024-05-04T07:51:43.103377+0000","last_became_peered":"2024-05-04T07:51:43.103377+0000","last_unstale":"2024-05-04T07:51:44.105570+0000","last_undegraded":"2024-05-04T07:51:44.105570+0000","last_fullsized":"2024-05-04T07:51:44.105570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.120345+0000","last_change":"2024-05-04T07:51:44.115510+0000","last_active":"2024-05-04T07:51:44.120345+0000","last_peered":"2024-05-04T07:51:44.120345+0000","last_clean":"2024-05-04T07:51:44.120345+0000","last_became_active":"2024-05-04T07:51:44.115022+0000","last_became_peered":"2024-05-04T07:51:44.115022+0000","last_unstale":"2024-05-04T07:51:44.120345+0000","last_undegraded":"2024-05-04T07:51:44.120345+0000","last_fullsized":"2024-05-04T07:51:44.120345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:51:36.500536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.104648+0000","last_change":"2024-05-04T07:51:43.103702+0000","last_active":"2024-05-04T07:51:44.104648+0000","last_peered":"2024-05-04T07:51:44.104648+0000","last_clean":"2024-05-04T07:51:44.104648+0000","last_became_active":"2024-05-04T07:51:43.103383+0000","last_became_peered":"2024-05-04T07:51:43.103383+0000","last_unstale":"2024-05-04T07:51:44.104648+0000","last_undegraded":"2024-05-04T07:51:44.104648+0000","last_fullsized":"2024-05-04T07:51:44.104648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:28.503884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.117899+0000","last_change":"2024-05-04T07:51:44.114282+0000","last_active":"2024-05-04T07:51:44.117899+0000","last_peered":"2024-05-04T07:51:44.117899+0000","last_clean":"2024-05-04T07:51:44.117899+0000","last_became_active":"2024-05-04T07:51:44.113958+0000","last_became_peered":"2024-05-04T07:51:44.113958+0000","last_unstale":"2024-05-04T07:51:44.117899+0000","last_undegraded":"2024-05-04T07:51:44.117899+0000","last_fullsized":"2024-05-04T07:51:44.117899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.115728+0000","last_change":"2024-05-04T07:51:43.111342+0000","last_active":"2024-05-04T07:51:44.115728+0000","last_peered":"2024-05-04T07:51:44.115728+0000","last_clean":"2024-05-04T07:51:44.115728+0000","last_became_active":"2024-05-04T07:51:43.110352+0000","last_became_peered":"2024-05-04T07:51:43.110352+0000","last_unstale":"2024-05-04T07:51:44.115728+0000","last_undegraded":"2024-05-04T07:51:44.115728+0000","last_fullsized":"2024-05-04T07:51:44.115728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:14.118268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135618+0000","last_change":"2024-05-04T07:51:44.127934+0000","last_active":"2024-05-04T07:51:44.135618+0000","last_peered":"2024-05-04T07:51:44.135618+0000","last_clean":"2024-05-04T07:51:44.135618+0000","last_became_active":"2024-05-04T07:51:44.127676+0000","last_became_peered":"2024-05-04T07:51:44.127676+0000","last_unstale":"2024-05-04T07:51:44.135618+0000","last_undegraded":"2024-05-04T07:51:44.135618+0000","last_fullsized":"2024-05-04T07:51:44.135618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140989+0000","last_change":"2024-05-04T07:51:43.111648+0000","last_active":"2024-05-04T07:51:44.140989+0000","last_peered":"2024-05-04T07:51:44.140989+0000","last_clean":"2024-05-04T07:51:44.140989+0000","last_became_active":"2024-05-04T07:51:43.111308+0000","last_became_peered":"2024-05-04T07:51:43.111308+0000","last_unstale":"2024-05-04T07:51:44.140989+0000","last_undegraded":"2024-05-04T07:51:44.140989+0000","last_fullsized":"2024-05-04T07:51:44.140989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127694+0000","last_change":"2024-05-04T07:51:44.118554+0000","last_active":"2024-05-04T07:51:44.127694+0000","last_peered":"2024-05-04T07:51:44.127694+0000","last_clean":"2024-05-04T07:51:44.127694+0000","last_became_active":"2024-05-04T07:51:44.118228+0000","last_became_peered":"2024-05-04T07:51:44.118228+0000","last_unstale":"2024-05-04T07:51:44.127694+0000","last_undegraded":"2024-05-04T07:51:44.127694+0000","last_fullsized":"2024-05-04T07:51:44.127694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.147609+0000","last_change":"2024-05-04T07:51:43.110234+0000","last_active":"2024-05-04T07:51:44.147609+0000","last_peered":"2024-05-04T07:51:44.147609+0000","last_clean":"2024-05-04T07:51:44.147609+0000","last_became_active":"2024-05-04T07:51:43.108846+0000","last_became_peered":"2024-05-04T07:51:43.108846+0000","last_unstale":"2024-05-04T07:51:44.147609+0000","last_undegraded":"2024-05-04T07:51:44.147609+0000","last_fullsized":"2024-05-04T07:51:44.147609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:14.118268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.129169+0000","last_change":"2024-05-04T07:51:44.125099+0000","last_active":"2024-05-04T07:51:44.129169+0000","last_peered":"2024-05-04T07:51:44.129169+0000","last_clean":"2024-05-04T07:51:44.129169+0000","last_became_active":"2024-05-04T07:51:44.124324+0000","last_became_peered":"2024-05-04T07:51:44.124324+0000","last_unstale":"2024-05-04T07:51:44.129169+0000","last_undegraded":"2024-05-04T07:51:44.129169+0000","last_fullsized":"2024-05-04T07:51:44.129169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144349+0000","last_change":"2024-05-04T07:51:43.098221+0000","last_active":"2024-05-04T07:51:44.144349+0000","last_peered":"2024-05-04T07:51:44.144349+0000","last_clean":"2024-05-04T07:51:44.144349+0000","last_became_active":"2024-05-04T07:51:43.097947+0000","last_became_peered":"2024-05-04T07:51:43.097947+0000","last_unstale":"2024-05-04T07:51:44.144349+0000","last_undegraded":"2024-05-04T07:51:44.144349+0000","last_fullsized":"2024-05-04T07:51:44.144349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:51.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121447+0000","last_change":"2024-05-04T07:51:44.116327+0000","last_active":"2024-05-04T07:51:44.121447+0000","last_peered":"2024-05-04T07:51:44.121447+0000","last_clean":"2024-05-04T07:51:44.121447+0000","last_became_active":"2024-05-04T07:51:44.115982+0000","last_became_peered":"2024-05-04T07:51:44.115982+0000","last_unstale":"2024-05-04T07:51:44.121447+0000","last_undegraded":"2024-05-04T07:51:44.121447+0000","last_fullsized":"2024-05-04T07:51:44.121447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.109310+0000","last_change":"2024-05-04T07:51:43.113992+0000","last_active":"2024-05-04T07:51:44.109310+0000","last_peered":"2024-05-04T07:51:44.109310+0000","last_clean":"2024-05-04T07:51:44.109310+0000","last_became_active":"2024-05-04T07:51:43.113678+0000","last_became_peered":"2024-05-04T07:51:43.113678+0000","last_unstale":"2024-05-04T07:51:44.109310+0000","last_undegraded":"2024-05-04T07:51:44.109310+0000","last_fullsized":"2024-05-04T07:51:44.109310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:36.842655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.118181+0000","last_change":"2024-05-04T07:51:44.110572+0000","last_active":"2024-05-04T07:51:44.118181+0000","last_peered":"2024-05-04T07:51:44.118181+0000","last_clean":"2024-05-04T07:51:44.118181+0000","last_became_active":"2024-05-04T07:51:44.110266+0000","last_became_peered":"2024-05-04T07:51:44.110266+0000","last_unstale":"2024-05-04T07:51:44.118181+0000","last_undegraded":"2024-05-04T07:51:44.118181+0000","last_fullsized":"2024-05-04T07:51:44.118181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.090596+0000","last_change":"2024-05-04T07:51:43.104773+0000","last_active":"2024-05-04T07:51:44.090596+0000","last_peered":"2024-05-04T07:51:44.090596+0000","last_clean":"2024-05-04T07:51:44.090596+0000","last_became_active":"2024-05-04T07:51:43.104022+0000","last_became_peered":"2024-05-04T07:51:43.104022+0000","last_unstale":"2024-05-04T07:51:44.090596+0000","last_undegraded":"2024-05-04T07:51:44.090596+0000","last_fullsized":"2024-05-04T07:51:44.090596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:20:37.306500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138636+0000","last_change":"2024-05-04T07:51:44.120598+0000","last_active":"2024-05-04T07:51:44.138636+0000","last_peered":"2024-05-04T07:51:44.138636+0000","last_clean":"2024-05-04T07:51:44.138636+0000","last_became_active":"2024-05-04T07:51:44.119941+0000","last_became_peered":"2024-05-04T07:51:44.119941+0000","last_unstale":"2024-05-04T07:51:44.138636+0000","last_undegraded":"2024-05-04T07:51:44.138636+0000","last_fullsized":"2024-05-04T07:51:44.138636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137347+0000","last_change":"2024-05-04T07:51:43.114876+0000","last_active":"2024-05-04T07:51:44.137347+0000","last_peered":"2024-05-04T07:51:44.137347+0000","last_clean":"2024-05-04T07:51:44.137347+0000","last_became_active":"2024-05-04T07:51:43.114526+0000","last_became_peered":"2024-05-04T07:51:43.114526+0000","last_unstale":"2024-05-04T07:51:44.137347+0000","last_undegraded":"2024-05-04T07:51:44.137347+0000","last_fullsized":"2024-05-04T07:51:44.137347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:36.842655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130492+0000","last_change":"2024-05-04T07:51:44.117686+0000","last_active":"2024-05-04T07:51:44.130492+0000","last_peered":"2024-05-04T07:51:44.130492+0000","last_clean":"2024-05-04T07:51:44.130492+0000","last_became_active":"2024-05-04T07:51:44.117099+0000","last_became_peered":"2024-05-04T07:51:44.117099+0000","last_unstale":"2024-05-04T07:51:44.130492+0000","last_undegraded":"2024-05-04T07:51:44.130492+0000","last_fullsized":"2024-05-04T07:51:44.130492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144789+0000","last_change":"2024-05-04T07:51:43.116453+0000","last_active":"2024-05-04T07:51:44.144789+0000","last_peered":"2024-05-04T07:51:44.144789+0000","last_clean":"2024-05-04T07:51:44.144789+0000","last_became_active":"2024-05-04T07:51:43.115842+0000","last_became_peered":"2024-05-04T07:51:43.115842+0000","last_unstale":"2024-05-04T07:51:44.144789+0000","last_undegraded":"2024-05-04T07:51:44.144789+0000","last_fullsized":"2024-05-04T07:51:44.144789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:51.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137035+0000","last_change":"2024-05-04T07:51:44.130877+0000","last_active":"2024-05-04T07:51:44.137035+0000","last_peered":"2024-05-04T07:51:44.137035+0000","last_clean":"2024-05-04T07:51:44.137035+0000","last_became_active":"2024-05-04T07:51:44.130215+0000","last_became_peered":"2024-05-04T07:51:44.130215+0000","last_unstale":"2024-05-04T07:51:44.137035+0000","last_undegraded":"2024-05-04T07:51:44.137035+0000","last_fullsized":"2024-05-04T07:51:44.137035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.145205+0000","last_change":"2024-05-04T07:51:43.114381+0000","last_active":"2024-05-04T07:51:44.145205+0000","last_peered":"2024-05-04T07:51:44.145205+0000","last_clean":"2024-05-04T07:51:44.145205+0000","last_became_active":"2024-05-04T07:51:43.114095+0000","last_became_peered":"2024-05-04T07:51:43.114095+0000","last_unstale":"2024-05-04T07:51:44.145205+0000","last_undegraded":"2024-05-04T07:51:44.145205+0000","last_fullsized":"2024-05-04T07:51:44.145205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:15.172789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130934+0000","last_change":"2024-05-04T07:51:44.122317+0000","last_active":"2024-05-04T07:51:44.130934+0000","last_peered":"2024-05-04T07:51:44.130934+0000","last_clean":"2024-05-04T07:51:44.130934+0000","last_became_active":"2024-05-04T07:51:44.121851+0000","last_became_peered":"2024-05-04T07:51:44.121851+0000","last_unstale":"2024-05-04T07:51:44.130934+0000","last_undegraded":"2024-05-04T07:51:44.130934+0000","last_fullsized":"2024-05-04T07:51:44.130934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141354+0000","last_change":"2024-05-04T07:51:43.109580+0000","last_active":"2024-05-04T07:51:44.141354+0000","last_peered":"2024-05-04T07:51:44.141354+0000","last_clean":"2024-05-04T07:51:44.141354+0000","last_became_active":"2024-05-04T07:51:43.109191+0000","last_became_peered":"2024-05-04T07:51:43.109191+0000","last_unstale":"2024-05-04T07:51:44.141354+0000","last_undegraded":"2024-05-04T07:51:44.141354+0000","last_fullsized":"2024-05-04T07:51:44.141354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:12:17.305046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132923+0000","last_change":"2024-05-04T07:51:44.127201+0000","last_active":"2024-05-04T07:51:44.132923+0000","last_peered":"2024-05-04T07:51:44.132923+0000","last_clean":"2024-05-04T07:51:44.132923+0000","last_became_active":"2024-05-04T07:51:44.126901+0000","last_became_peered":"2024-05-04T07:51:44.126901+0000","last_unstale":"2024-05-04T07:51:44.132923+0000","last_undegraded":"2024-05-04T07:51:44.132923+0000","last_fullsized":"2024-05-04T07:51:44.132923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:55:43.326770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.110434+0000","last_change":"2024-05-04T07:51:43.110995+0000","last_active":"2024-05-04T07:51:44.110434+0000","last_peered":"2024-05-04T07:51:44.110434+0000","last_clean":"2024-05-04T07:51:44.110434+0000","last_became_active":"2024-05-04T07:51:43.110555+0000","last_became_peered":"2024-05-04T07:51:43.110555+0000","last_unstale":"2024-05-04T07:51:44.110434+0000","last_undegraded":"2024-05-04T07:51:44.110434+0000","last_fullsized":"2024-05-04T07:51:44.110434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:55.994820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.116270+0000","last_change":"2024-05-04T07:51:44.109313+0000","last_active":"2024-05-04T07:51:44.116270+0000","last_peered":"2024-05-04T07:51:44.116270+0000","last_clean":"2024-05-04T07:51:44.116270+0000","last_became_active":"2024-05-04T07:51:44.108902+0000","last_became_peered":"2024-05-04T07:51:44.108902+0000","last_unstale":"2024-05-04T07:51:44.116270+0000","last_undegraded":"2024-05-04T07:51:44.116270+0000","last_fullsized":"2024-05-04T07:51:44.116270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144039+0000","last_change":"2024-05-04T07:51:43.097502+0000","last_active":"2024-05-04T07:51:44.144039+0000","last_peered":"2024-05-04T07:51:44.144039+0000","last_clean":"2024-05-04T07:51:44.144039+0000","last_became_active":"2024-05-04T07:51:43.096940+0000","last_became_peered":"2024-05-04T07:51:43.096940+0000","last_unstale":"2024-05-04T07:51:44.144039+0000","last_undegraded":"2024-05-04T07:51:44.144039+0000","last_fullsized":"2024-05-04T07:51:44.144039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:22:05.577939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133846+0000","last_change":"2024-05-04T07:51:44.127205+0000","last_active":"2024-05-04T07:51:44.133846+0000","last_peered":"2024-05-04T07:51:44.133846+0000","last_clean":"2024-05-04T07:51:44.133846+0000","last_became_active":"2024-05-04T07:51:44.126954+0000","last_became_peered":"2024-05-04T07:51:44.126954+0000","last_unstale":"2024-05-04T07:51:44.133846+0000","last_undegraded":"2024-05-04T07:51:44.133846+0000","last_fullsized":"2024-05-04T07:51:44.133846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.085297+0000","last_change":"2024-05-04T07:51:43.102471+0000","last_active":"2024-05-04T07:51:44.085297+0000","last_peered":"2024-05-04T07:51:44.085297+0000","last_clean":"2024-05-04T07:51:44.085297+0000","last_became_active":"2024-05-04T07:51:43.102136+0000","last_became_peered":"2024-05-04T07:51:43.102136+0000","last_unstale":"2024-05-04T07:51:44.085297+0000","last_undegraded":"2024-05-04T07:51:44.085297+0000","last_fullsized":"2024-05-04T07:51:44.085297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:53:48.566384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130175+0000","last_change":"2024-05-04T07:51:44.123232+0000","last_active":"2024-05-04T07:51:44.130175+0000","last_peered":"2024-05-04T07:51:44.130175+0000","last_clean":"2024-05-04T07:51:44.130175+0000","last_became_active":"2024-05-04T07:51:44.122556+0000","last_became_peered":"2024-05-04T07:51:44.122556+0000","last_unstale":"2024-05-04T07:51:44.130175+0000","last_undegraded":"2024-05-04T07:51:44.130175+0000","last_fullsized":"2024-05-04T07:51:44.130175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.092347+0000","last_change":"2024-05-04T07:51:43.108090+0000","last_active":"2024-05-04T07:51:44.092347+0000","last_peered":"2024-05-04T07:51:44.092347+0000","last_clean":"2024-05-04T07:51:44.092347+0000","last_became_active":"2024-05-04T07:51:43.107780+0000","last_became_peered":"2024-05-04T07:51:43.107780+0000","last_unstale":"2024-05-04T07:51:44.092347+0000","last_undegraded":"2024-05-04T07:51:44.092347+0000","last_fullsized":"2024-05-04T07:51:44.092347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138679+0000","last_change":"2024-05-04T07:51:44.122172+0000","last_active":"2024-05-04T07:51:44.138679+0000","last_peered":"2024-05-04T07:51:44.138679+0000","last_clean":"2024-05-04T07:51:44.138679+0000","last_became_active":"2024-05-04T07:51:44.115805+0000","last_became_peered":"2024-05-04T07:51:44.115805+0000","last_unstale":"2024-05-04T07:51:44.138679+0000","last_undegraded":"2024-05-04T07:51:44.138679+0000","last_fullsized":"2024-05-04T07:51:44.138679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:54:17.379215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.086272+0000","last_change":"2024-05-04T07:51:43.096112+0000","last_active":"2024-05-04T07:51:44.086272+0000","last_peered":"2024-05-04T07:51:44.086272+0000","last_clean":"2024-05-04T07:51:44.086272+0000","last_became_active":"2024-05-04T07:51:43.095704+0000","last_became_peered":"2024-05-04T07:51:43.095704+0000","last_unstale":"2024-05-04T07:51:44.086272+0000","last_undegraded":"2024-05-04T07:51:44.086272+0000","last_fullsized":"2024-05-04T07:51:44.086272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:14.488687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124452+0000","last_change":"2024-05-04T07:51:44.118386+0000","last_active":"2024-05-04T07:51:44.124452+0000","last_peered":"2024-05-04T07:51:44.124452+0000","last_clean":"2024-05-04T07:51:44.124452+0000","last_became_active":"2024-05-04T07:51:44.118138+0000","last_became_peered":"2024-05-04T07:51:44.118138+0000","last_unstale":"2024-05-04T07:51:44.124452+0000","last_undegraded":"2024-05-04T07:51:44.124452+0000","last_fullsized":"2024-05-04T07:51:44.124452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141138+0000","last_change":"2024-05-04T07:51:43.112887+0000","last_active":"2024-05-04T07:51:44.141138+0000","last_peered":"2024-05-04T07:51:44.141138+0000","last_clean":"2024-05-04T07:51:44.141138+0000","last_became_active":"2024-05-04T07:51:43.112585+0000","last_became_peered":"2024-05-04T07:51:43.112585+0000","last_unstale":"2024-05-04T07:51:44.141138+0000","last_undegraded":"2024-05-04T07:51:44.141138+0000","last_fullsized":"2024-05-04T07:51:44.141138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:34.397975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121332+0000","last_change":"2024-05-04T07:51:44.116506+0000","last_active":"2024-05-04T07:51:44.121332+0000","last_peered":"2024-05-04T07:51:44.121332+0000","last_clean":"2024-05-04T07:51:44.121332+0000","last_became_active":"2024-05-04T07:51:44.115837+0000","last_became_peered":"2024-05-04T07:51:44.115837+0000","last_unstale":"2024-05-04T07:51:44.121332+0000","last_undegraded":"2024-05-04T07:51:44.121332+0000","last_fullsized":"2024-05-04T07:51:44.121332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.085596+0000","last_change":"2024-05-04T07:51:43.111836+0000","last_active":"2024-05-04T07:51:44.085596+0000","last_peered":"2024-05-04T07:51:44.085596+0000","last_clean":"2024-05-04T07:51:44.085596+0000","last_became_active":"2024-05-04T07:51:43.111548+0000","last_became_peered":"2024-05-04T07:51:43.111548+0000","last_unstale":"2024-05-04T07:51:44.085596+0000","last_undegraded":"2024-05-04T07:51:44.085596+0000","last_fullsized":"2024-05-04T07:51:44.085596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:22:23.750383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141850+0000","last_change":"2024-05-04T07:51:44.136525+0000","last_active":"2024-05-04T07:51:44.141850+0000","last_peered":"2024-05-04T07:51:44.141850+0000","last_clean":"2024-05-04T07:51:44.141850+0000","last_became_active":"2024-05-04T07:51:44.124684+0000","last_became_peered":"2024-05-04T07:51:44.124684+0000","last_unstale":"2024-05-04T07:51:44.141850+0000","last_undegraded":"2024-05-04T07:51:44.141850+0000","last_fullsized":"2024-05-04T07:51:44.141850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:37:28.585868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.107607+0000","last_change":"2024-05-04T07:51:43.108916+0000","last_active":"2024-05-04T07:51:44.107607+0000","last_peered":"2024-05-04T07:51:44.107607+0000","last_clean":"2024-05-04T07:51:44.107607+0000","last_became_active":"2024-05-04T07:51:43.108616+0000","last_became_peered":"2024-05-04T07:51:43.108616+0000","last_unstale":"2024-05-04T07:51:44.107607+0000","last_undegraded":"2024-05-04T07:51:44.107607+0000","last_fullsized":"2024-05-04T07:51:44.107607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.129186+0000","last_change":"2024-05-04T07:51:44.125138+0000","last_active":"2024-05-04T07:51:44.129186+0000","last_peered":"2024-05-04T07:51:44.129186+0000","last_clean":"2024-05-04T07:51:44.129186+0000","last_became_active":"2024-05-04T07:51:44.124844+0000","last_became_peered":"2024-05-04T07:51:44.124844+0000","last_unstale":"2024-05-04T07:51:44.129186+0000","last_undegraded":"2024-05-04T07:51:44.129186+0000","last_fullsized":"2024-05-04T07:51:44.129186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.108889+0000","last_change":"2024-05-04T07:51:43.101476+0000","last_active":"2024-05-04T07:51:44.108889+0000","last_peered":"2024-05-04T07:51:44.108889+0000","last_clean":"2024-05-04T07:51:44.108889+0000","last_became_active":"2024-05-04T07:51:43.101097+0000","last_became_peered":"2024-05-04T07:51:43.101097+0000","last_unstale":"2024-05-04T07:51:44.108889+0000","last_undegraded":"2024-05-04T07:51:44.108889+0000","last_fullsized":"2024-05-04T07:51:44.108889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:44.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135346+0000","last_change":"2024-05-04T07:51:44.128620+0000","last_active":"2024-05-04T07:51:44.135346+0000","last_peered":"2024-05-04T07:51:44.135346+0000","last_clean":"2024-05-04T07:51:44.135346+0000","last_became_active":"2024-05-04T07:51:44.128336+0000","last_became_peered":"2024-05-04T07:51:44.128336+0000","last_unstale":"2024-05-04T07:51:44.135346+0000","last_undegraded":"2024-05-04T07:51:44.135346+0000","last_fullsized":"2024-05-04T07:51:44.135346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.090319+0000","last_change":"2024-05-04T07:51:43.100879+0000","last_active":"2024-05-04T07:51:44.090319+0000","last_peered":"2024-05-04T07:51:44.090319+0000","last_clean":"2024-05-04T07:51:44.090319+0000","last_became_active":"2024-05-04T07:51:43.098113+0000","last_became_peered":"2024-05-04T07:51:43.098113+0000","last_unstale":"2024-05-04T07:51:44.090319+0000","last_undegraded":"2024-05-04T07:51:44.090319+0000","last_fullsized":"2024-05-04T07:51:44.090319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:25:00.872110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127731+0000","last_change":"2024-05-04T07:51:44.120880+0000","last_active":"2024-05-04T07:51:44.127731+0000","last_peered":"2024-05-04T07:51:44.127731+0000","last_clean":"2024-05-04T07:51:44.127731+0000","last_became_active":"2024-05-04T07:51:44.120454+0000","last_became_peered":"2024-05-04T07:51:44.120454+0000","last_unstale":"2024-05-04T07:51:44.127731+0000","last_undegraded":"2024-05-04T07:51:44.127731+0000","last_fullsized":"2024-05-04T07:51:44.127731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105301+0000","last_change":"2024-05-04T07:51:43.104834+0000","last_active":"2024-05-04T07:51:44.105301+0000","last_peered":"2024-05-04T07:51:44.105301+0000","last_clean":"2024-05-04T07:51:44.105301+0000","last_became_active":"2024-05-04T07:51:43.104541+0000","last_became_peered":"2024-05-04T07:51:43.104541+0000","last_unstale":"2024-05-04T07:51:44.105301+0000","last_undegraded":"2024-05-04T07:51:44.105301+0000","last_fullsized":"2024-05-04T07:51:44.105301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:25:00.872110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.118088+0000","last_change":"2024-05-04T07:51:44.110330+0000","last_active":"2024-05-04T07:51:44.118088+0000","last_peered":"2024-05-04T07:51:44.118088+0000","last_clean":"2024-05-04T07:51:44.118088+0000","last_became_active":"2024-05-04T07:51:44.109867+0000","last_became_peered":"2024-05-04T07:51:44.109867+0000","last_unstale":"2024-05-04T07:51:44.118088+0000","last_undegraded":"2024-05-04T07:51:44.118088+0000","last_fullsized":"2024-05-04T07:51:44.118088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.096967+0000","last_change":"2024-05-04T07:51:43.103048+0000","last_active":"2024-05-04T07:51:44.096967+0000","last_peered":"2024-05-04T07:51:44.096967+0000","last_clean":"2024-05-04T07:51:44.096967+0000","last_became_active":"2024-05-04T07:51:43.102722+0000","last_became_peered":"2024-05-04T07:51:43.102722+0000","last_unstale":"2024-05-04T07:51:44.096967+0000","last_undegraded":"2024-05-04T07:51:44.096967+0000","last_fullsized":"2024-05-04T07:51:44.096967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137006+0000","last_change":"2024-05-04T07:51:44.131838+0000","last_active":"2024-05-04T07:51:44.137006+0000","last_peered":"2024-05-04T07:51:44.137006+0000","last_clean":"2024-05-04T07:51:44.137006+0000","last_became_active":"2024-05-04T07:51:44.131567+0000","last_became_peered":"2024-05-04T07:51:44.131567+0000","last_unstale":"2024-05-04T07:51:44.137006+0000","last_undegraded":"2024-05-04T07:51:44.137006+0000","last_fullsized":"2024-05-04T07:51:44.137006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:37:28.585868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.095659+0000","last_change":"2024-05-04T07:51:43.115299+0000","last_active":"2024-05-04T07:51:44.095659+0000","last_peered":"2024-05-04T07:51:44.095659+0000","last_clean":"2024-05-04T07:51:44.095659+0000","last_became_active":"2024-05-04T07:51:43.114671+0000","last_became_peered":"2024-05-04T07:51:43.114671+0000","last_unstale":"2024-05-04T07:51:44.095659+0000","last_undegraded":"2024-05-04T07:51:44.095659+0000","last_fullsized":"2024-05-04T07:51:44.095659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":144,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.088188+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:51:44.088188+0000","last_peered":"2024-05-04T07:51:44.088188+0000","last_clean":"2024-05-04T07:51:44.088188+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:51:44.088188+0000","last_undegraded":"2024-05-04T07:51:44.088188+0000","last_fullsized":"2024-05-04T07:51:44.088188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1019904,"data_stored":772406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":779573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:51:48.540 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:51:48.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.773+0000 7f80fcc00640 1 Processor -- start 2024-05-04T07:51:48.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.773+0000 7f80fcc00640 1 -- start start 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80fcc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80f80d3460 0x7f80f80d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80fcc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80f80b31f0 0x7f80f80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80fcc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f80d3d80 con 0x7f80f80b1c60 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80fcc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f80f80b2170 con 0x7f80f80b31f0 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80fcc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f80f80b2430 con 0x7f80f80d3460 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80f7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80f80b31f0 0x7f80f80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80f7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f80f80b31f0 0x7f80f80b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54014/0 (socket says 172.21.15.136:54014) 2024-05-04T07:51:48.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.775+0000 7f80f7e00640 1 -- 172.21.15.136:0/1291315933 learned_addr learned my addr 172.21.15.136:0/1291315933 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.776+0000 7f80f7400640 1 --2- 172.21.15.136:0/1291315933 >> v2:172.21.15.142:3300/0 conn(0x7f80f80d3460 0x7f80f80d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.776+0000 7f80f7e00640 1 -- 172.21.15.136:0/1291315933 >> v2:172.21.15.142:3300/0 conn(0x7f80f80d3460 msgr2=0x7f80f80d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.776+0000 7f80f7e00640 1 --2- 172.21.15.136:0/1291315933 >> v2:172.21.15.142:3300/0 conn(0x7f80f80d3460 0x7f80f80d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.776+0000 7f80f7e00640 1 -- 172.21.15.136:0/1291315933 >> v1:172.21.15.142:6789/0 conn(0x7f80f80b1c60 legacy=0x7f80f80d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.776+0000 7f80f7e00640 1 -- 172.21.15.136:0/1291315933 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f80b2710 con 0x7f80f80b31f0 2024-05-04T07:51:48.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.777+0000 7f80f7e00640 1 --2- 172.21.15.136:0/1291315933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b31f0 0x7f80f80b3620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80f806cc50 tx=0x7f80f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e463ace70656e5e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.777+0000 7f80f6a00640 1 -- 172.21.15.136:0/1291315933 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0036070 con 0x7f80f80b31f0 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.777+0000 7f80f6a00640 1 -- 172.21.15.136:0/1291315933 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0031600 con 0x7f80f80b31f0 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.777+0000 7f80f6a00640 1 -- 172.21.15.136:0/1291315933 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00319d0 con 0x7f80f80b31f0 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 -- 172.21.15.136:0/1291315933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b31f0 msgr2=0x7f80f80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 --2- 172.21.15.136:0/1291315933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b31f0 0x7f80f80b3620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f80f806cc50 tx=0x7f80f002a610 comp rx=0 tx=0).stop 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 -- 172.21.15.136:0/1291315933 shutdown_connections 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 --2- 172.21.15.136:0/1291315933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b31f0 0x7f80f80b3620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 --2- 172.21.15.136:0/1291315933 >> v2:172.21.15.142:3300/0 conn(0x7f80f80d3460 0x7f80f80d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 -- 172.21.15.136:0/1291315933 >> 172.21.15.136:0/1291315933 conn(0x7f80f809e370 msgr2=0x7f80f80d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 -- 172.21.15.136:0/1291315933 shutdown_connections 2024-05-04T07:51:48.780 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.778+0000 7f80fcc00640 1 -- 172.21.15.136:0/1291315933 wait complete. 2024-05-04T07:51:48.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.780+0000 7f80fcc00640 1 Processor -- start 2024-05-04T07:51:48.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.780+0000 7f80fcc00640 1 -- start start 2024-05-04T07:51:48.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b31f0 0x7f80f80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f80d3460 0x7f80f8160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.783 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8163ae0 con 0x7f80f80b1c60 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80f80b2cd0 con 0x7f80f80b31f0 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80fcc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f80f8163c60 con 0x7f80f80d3460 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80f7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80f7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54020/0 (socket says 172.21.15.136:54020) 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.781+0000 7f80f7400640 1 -- 172.21.15.136:0/737078621 learned_addr learned my addr 172.21.15.136:0/737078621 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 -- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f80d3460 msgr2=0x7f80f8160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7e00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f80d3460 0x7f80f8160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f80d3460 0x7f80f8160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 -- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b31f0 msgr2=0x7f80f80cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80efe00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b31f0 0x7f80f80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b31f0 0x7f80f80cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 -- 172.21.15.136:0/737078621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f80c9060 con 0x7f80f80b1c60 2024-05-04T07:51:48.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80f7400640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8015070 con 0x7f80f80b1c60 2024-05-04T07:51:48.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e8004220 con 0x7f80f80b1c60 2024-05-04T07:51:48.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007620 con 0x7f80f80b1c60 2024-05-04T07:51:48.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.782+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f80cb480 con 0x7f80f80b1c60 2024-05-04T07:51:48.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.783+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f80cc930 con 0x7f80f80b1c60 2024-05-04T07:51:48.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.784+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f80cb290 con 0x7f80f80b1c60 2024-05-04T07:51:48.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.785+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f80e80079d0 con 0x7f80f80b1c60 2024-05-04T07:51:48.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.786+0000 7f80ef400640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 0x7f80d40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:48.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.786+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f80e80977c0 con 0x7f80f80b1c60 2024-05-04T07:51:48.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.786+0000 7f80efe00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 0x7f80d40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:48.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.787+0000 7f80efe00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 0x7f80d40787c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80f8160000 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:48.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.790+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f80e8060f80 con 0x7f80f80b1c60 2024-05-04T07:51:48.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:48.994+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80f8069400 con 0x7f80d4076300 2024-05-04T07:51:49.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.005+0000 7f80ef400640 1 -- 172.21.15.136:0/737078621 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251877 (secure 0 0 0) 0x7f80f8069400 con 0x7f80d4076300 2024-05-04T07:51:49.008 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:49.012 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:51:49.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 msgr2=0x7f80d40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 0x7f80d40787c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80f8160000 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:49.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 msgr2=0x7f80f814f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800ccb0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 shutdown_connections 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80d4076300 0x7f80d40787c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f80d3460 0x7f80f8160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f80b31f0 0x7f80f80cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 --2- 172.21.15.136:0/737078621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f80f80b1c60 0x7f80f814f550 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 >> 172.21.15.136:0/737078621 conn(0x7f80f809e370 msgr2=0x7f80f806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 shutdown_connections 2024-05-04T07:51:49.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.011+0000 7f80fcc00640 1 -- 172.21.15.136:0/737078621 wait complete. 2024-05-04T07:51:49.029 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-05-04T07:51:47.297875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4500,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4608000,"data_stored":2644207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.239450"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136662+0000","last_change":"2024-05-04T07:51:44.118898+0000","last_active":"2024-05-04T07:51:44.136662+0000","last_peered":"2024-05-04T07:51:44.136662+0000","last_clean":"2024-05-04T07:51:44.136662+0000","last_became_active":"2024-05-04T07:51:44.118604+0000","last_became_peered":"2024-05-04T07:51:44.118604+0000","last_unstale":"2024-05-04T07:51:44.136662+0000","last_undegraded":"2024-05-04T07:51:44.136662+0000","last_fullsized":"2024-05-04T07:51:44.136662+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124882+0000","last_change":"2024-05-04T07:51:44.116773+0000","last_active":"2024-05-04T07:51:44.124882+0000","last_peered":"2024-05-04T07:51:44.124882+0000","last_clean":"2024-05-04T07:51:44.124882+0000","last_became_active":"2024-05-04T07:51:44.116282+0000","last_became_peered":"2024-05-04T07:51:44.116282+0000","last_unstale":"2024-05-04T07:51:44.124882+0000","last_undegraded":"2024-05-04T07:51:44.124882+0000","last_fullsized":"2024-05-04T07:51:44.124882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133346+0000","last_change":"2024-05-04T07:51:44.125538+0000","last_active":"2024-05-04T07:51:44.133346+0000","last_peered":"2024-05-04T07:51:44.133346+0000","last_clean":"2024-05-04T07:51:44.133346+0000","last_became_active":"2024-05-04T07:51:44.124353+0000","last_became_peered":"2024-05-04T07:51:44.124353+0000","last_unstale":"2024-05-04T07:51:44.133346+0000","last_undegraded":"2024-05-04T07:51:44.133346+0000","last_fullsized":"2024-05-04T07:51:44.133346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.120320+0000","last_change":"2024-05-04T07:51:44.115300+0000","last_active":"2024-05-04T07:51:44.120320+0000","last_peered":"2024-05-04T07:51:44.120320+0000","last_clean":"2024-05-04T07:51:44.120320+0000","last_became_active":"2024-05-04T07:51:44.114668+0000","last_became_peered":"2024-05-04T07:51:44.114668+0000","last_unstale":"2024-05-04T07:51:44.120320+0000","last_undegraded":"2024-05-04T07:51:44.120320+0000","last_fullsized":"2024-05-04T07:51:44.120320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:37.859798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133257+0000","last_change":"2024-05-04T07:51:44.127995+0000","last_active":"2024-05-04T07:51:44.133257+0000","last_peered":"2024-05-04T07:51:44.133257+0000","last_clean":"2024-05-04T07:51:44.133257+0000","last_became_active":"2024-05-04T07:51:44.127666+0000","last_became_peered":"2024-05-04T07:51:44.127666+0000","last_unstale":"2024-05-04T07:51:44.133257+0000","last_undegraded":"2024-05-04T07:51:44.133257+0000","last_fullsized":"2024-05-04T07:51:44.133257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:53:09.175880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132617+0000","last_change":"2024-05-04T07:51:44.127956+0000","last_active":"2024-05-04T07:51:44.132617+0000","last_peered":"2024-05-04T07:51:44.132617+0000","last_clean":"2024-05-04T07:51:44.132617+0000","last_became_active":"2024-05-04T07:51:44.127640+0000","last_became_peered":"2024-05-04T07:51:44.127640+0000","last_unstale":"2024-05-04T07:51:44.132617+0000","last_undegraded":"2024-05-04T07:51:44.132617+0000","last_fullsized":"2024-05-04T07:51:44.132617+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137006+0000","last_change":"2024-05-04T07:51:44.132403+0000","last_active":"2024-05-04T07:51:44.137006+0000","last_peered":"2024-05-04T07:51:44.137006+0000","last_clean":"2024-05-04T07:51:44.137006+0000","last_became_active":"2024-05-04T07:51:44.132117+0000","last_became_peered":"2024-05-04T07:51:44.132117+0000","last_unstale":"2024-05-04T07:51:44.137006+0000","last_undegraded":"2024-05-04T07:51:44.137006+0000","last_fullsized":"2024-05-04T07:51:44.137006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:42:15.806425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121430+0000","last_change":"2024-05-04T07:51:44.116339+0000","last_active":"2024-05-04T07:51:44.121430+0000","last_peered":"2024-05-04T07:51:44.121430+0000","last_clean":"2024-05-04T07:51:44.121430+0000","last_became_active":"2024-05-04T07:51:44.116023+0000","last_became_peered":"2024-05-04T07:51:44.116023+0000","last_unstale":"2024-05-04T07:51:44.121430+0000","last_undegraded":"2024-05-04T07:51:44.121430+0000","last_fullsized":"2024-05-04T07:51:44.121430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.143560+0000","last_change":"2024-05-04T07:51:44.134816+0000","last_active":"2024-05-04T07:51:44.143560+0000","last_peered":"2024-05-04T07:51:44.143560+0000","last_clean":"2024-05-04T07:51:44.143560+0000","last_became_active":"2024-05-04T07:51:44.134262+0000","last_became_peered":"2024-05-04T07:51:44.134262+0000","last_unstale":"2024-05-04T07:51:44.143560+0000","last_undegraded":"2024-05-04T07:51:44.143560+0000","last_fullsized":"2024-05-04T07:51:44.143560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134605+0000","last_change":"2024-05-04T07:51:44.125667+0000","last_active":"2024-05-04T07:51:44.134605+0000","last_peered":"2024-05-04T07:51:44.134605+0000","last_clean":"2024-05-04T07:51:44.134605+0000","last_became_active":"2024-05-04T07:51:44.125385+0000","last_became_peered":"2024-05-04T07:51:44.125385+0000","last_unstale":"2024-05-04T07:51:44.134605+0000","last_undegraded":"2024-05-04T07:51:44.134605+0000","last_fullsized":"2024-05-04T07:51:44.134605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134645+0000","last_change":"2024-05-04T07:51:44.126496+0000","last_active":"2024-05-04T07:51:44.134645+0000","last_peered":"2024-05-04T07:51:44.134645+0000","last_clean":"2024-05-04T07:51:44.134645+0000","last_became_active":"2024-05-04T07:51:44.125342+0000","last_became_peered":"2024-05-04T07:51:44.125342+0000","last_unstale":"2024-05-04T07:51:44.134645+0000","last_undegraded":"2024-05-04T07:51:44.134645+0000","last_fullsized":"2024-05-04T07:51:44.134645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133795+0000","last_change":"2024-05-04T07:51:44.125532+0000","last_active":"2024-05-04T07:51:44.133795+0000","last_peered":"2024-05-04T07:51:44.133795+0000","last_clean":"2024-05-04T07:51:44.133795+0000","last_became_active":"2024-05-04T07:51:44.124452+0000","last_became_peered":"2024-05-04T07:51:44.124452+0000","last_unstale":"2024-05-04T07:51:44.133795+0000","last_undegraded":"2024-05-04T07:51:44.133795+0000","last_fullsized":"2024-05-04T07:51:44.133795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.131792+0000","last_change":"2024-05-04T07:51:44.124027+0000","last_active":"2024-05-04T07:51:44.131792+0000","last_peered":"2024-05-04T07:51:44.131792+0000","last_clean":"2024-05-04T07:51:44.131792+0000","last_became_active":"2024-05-04T07:51:44.123683+0000","last_became_peered":"2024-05-04T07:51:44.123683+0000","last_unstale":"2024-05-04T07:51:44.131792+0000","last_undegraded":"2024-05-04T07:51:44.131792+0000","last_fullsized":"2024-05-04T07:51:44.131792+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130818+0000","last_change":"2024-05-04T07:51:44.121354+0000","last_active":"2024-05-04T07:51:44.130818+0000","last_peered":"2024-05-04T07:51:44.130818+0000","last_clean":"2024-05-04T07:51:44.130818+0000","last_became_active":"2024-05-04T07:51:44.121003+0000","last_became_peered":"2024-05-04T07:51:44.121003+0000","last_unstale":"2024-05-04T07:51:44.130818+0000","last_undegraded":"2024-05-04T07:51:44.130818+0000","last_fullsized":"2024-05-04T07:51:44.130818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.131273+0000","last_change":"2024-05-04T07:51:44.119323+0000","last_active":"2024-05-04T07:51:44.131273+0000","last_peered":"2024-05-04T07:51:44.131273+0000","last_clean":"2024-05-04T07:51:44.131273+0000","last_became_active":"2024-05-04T07:51:44.119035+0000","last_became_peered":"2024-05-04T07:51:44.119035+0000","last_unstale":"2024-05-04T07:51:44.131273+0000","last_undegraded":"2024-05-04T07:51:44.131273+0000","last_fullsized":"2024-05-04T07:51:44.131273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.125534+0000","last_change":"2024-05-04T07:51:44.120713+0000","last_active":"2024-05-04T07:51:44.125534+0000","last_peered":"2024-05-04T07:51:44.125534+0000","last_clean":"2024-05-04T07:51:44.125534+0000","last_became_active":"2024-05-04T07:51:44.120193+0000","last_became_peered":"2024-05-04T07:51:44.120193+0000","last_unstale":"2024-05-04T07:51:44.125534+0000","last_undegraded":"2024-05-04T07:51:44.125534+0000","last_fullsized":"2024-05-04T07:51:44.125534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124803+0000","last_change":"2024-05-04T07:51:44.120654+0000","last_active":"2024-05-04T07:51:44.124803+0000","last_peered":"2024-05-04T07:51:44.124803+0000","last_clean":"2024-05-04T07:51:44.124803+0000","last_became_active":"2024-05-04T07:51:44.120314+0000","last_became_peered":"2024-05-04T07:51:44.120314+0000","last_unstale":"2024-05-04T07:51:44.124803+0000","last_undegraded":"2024-05-04T07:51:44.124803+0000","last_fullsized":"2024-05-04T07:51:44.124803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:23:35.672910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134080+0000","last_change":"2024-05-04T07:51:44.126867+0000","last_active":"2024-05-04T07:51:44.134080+0000","last_peered":"2024-05-04T07:51:44.134080+0000","last_clean":"2024-05-04T07:51:44.134080+0000","last_became_active":"2024-05-04T07:51:44.125396+0000","last_became_peered":"2024-05-04T07:51:44.125396+0000","last_unstale":"2024-05-04T07:51:44.134080+0000","last_undegraded":"2024-05-04T07:51:44.134080+0000","last_fullsized":"2024-05-04T07:51:44.134080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.119642+0000","last_change":"2024-05-04T07:51:44.106695+0000","last_active":"2024-05-04T07:51:44.119642+0000","last_peered":"2024-05-04T07:51:44.119642+0000","last_clean":"2024-05-04T07:51:44.119642+0000","last_became_active":"2024-05-04T07:51:44.106382+0000","last_became_peered":"2024-05-04T07:51:44.106382+0000","last_unstale":"2024-05-04T07:51:44.119642+0000","last_undegraded":"2024-05-04T07:51:44.119642+0000","last_fullsized":"2024-05-04T07:51:44.119642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:44:58.149048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121302+0000","last_change":"2024-05-04T07:51:44.116295+0000","last_active":"2024-05-04T07:51:44.121302+0000","last_peered":"2024-05-04T07:51:44.121302+0000","last_clean":"2024-05-04T07:51:44.121302+0000","last_became_active":"2024-05-04T07:51:44.115473+0000","last_became_peered":"2024-05-04T07:51:44.115473+0000","last_unstale":"2024-05-04T07:51:44.121302+0000","last_undegraded":"2024-05-04T07:51:44.121302+0000","last_fullsized":"2024-05-04T07:51:44.121302+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136967+0000","last_change":"2024-05-04T07:51:44.131233+0000","last_active":"2024-05-04T07:51:44.136967+0000","last_peered":"2024-05-04T07:51:44.136967+0000","last_clean":"2024-05-04T07:51:44.136967+0000","last_became_active":"2024-05-04T07:51:44.130885+0000","last_became_peered":"2024-05-04T07:51:44.130885+0000","last_unstale":"2024-05-04T07:51:44.136967+0000","last_undegraded":"2024-05-04T07:51:44.136967+0000","last_fullsized":"2024-05-04T07:51:44.136967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:54:17.379215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127498+0000","last_change":"2024-05-04T07:51:44.120115+0000","last_active":"2024-05-04T07:51:44.127498+0000","last_peered":"2024-05-04T07:51:44.127498+0000","last_clean":"2024-05-04T07:51:44.127498+0000","last_became_active":"2024-05-04T07:51:44.116894+0000","last_became_peered":"2024-05-04T07:51:44.116894+0000","last_unstale":"2024-05-04T07:51:44.127498+0000","last_undegraded":"2024-05-04T07:51:44.127498+0000","last_fullsized":"2024-05-04T07:51:44.127498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.103335+0000","last_change":"2024-05-04T07:51:44.099431+0000","last_active":"2024-05-04T07:51:44.103335+0000","last_peered":"2024-05-04T07:51:44.103335+0000","last_clean":"2024-05-04T07:51:44.103335+0000","last_became_active":"2024-05-04T07:51:44.098134+0000","last_became_peered":"2024-05-04T07:51:44.098134+0000","last_unstale":"2024-05-04T07:51:44.103335+0000","last_undegraded":"2024-05-04T07:51:44.103335+0000","last_fullsized":"2024-05-04T07:51:44.103335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105807+0000","last_change":"2024-05-04T07:51:44.100925+0000","last_active":"2024-05-04T07:51:44.105807+0000","last_peered":"2024-05-04T07:51:44.105807+0000","last_clean":"2024-05-04T07:51:44.105807+0000","last_became_active":"2024-05-04T07:51:44.100199+0000","last_became_peered":"2024-05-04T07:51:44.100199+0000","last_unstale":"2024-05-04T07:51:44.105807+0000","last_undegraded":"2024-05-04T07:51:44.105807+0000","last_fullsized":"2024-05-04T07:51:44.105807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:59:46.910228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121522+0000","last_change":"2024-05-04T07:51:44.117620+0000","last_active":"2024-05-04T07:51:44.121522+0000","last_peered":"2024-05-04T07:51:44.121522+0000","last_clean":"2024-05-04T07:51:44.121522+0000","last_became_active":"2024-05-04T07:51:44.117288+0000","last_became_peered":"2024-05-04T07:51:44.117288+0000","last_unstale":"2024-05-04T07:51:44.121522+0000","last_undegraded":"2024-05-04T07:51:44.121522+0000","last_fullsized":"2024-05-04T07:51:44.121522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124270+0000","last_change":"2024-05-04T07:51:44.118318+0000","last_active":"2024-05-04T07:51:44.124270+0000","last_peered":"2024-05-04T07:51:44.124270+0000","last_clean":"2024-05-04T07:51:44.124270+0000","last_became_active":"2024-05-04T07:51:44.118030+0000","last_became_peered":"2024-05-04T07:51:44.118030+0000","last_unstale":"2024-05-04T07:51:44.124270+0000","last_undegraded":"2024-05-04T07:51:44.124270+0000","last_fullsized":"2024-05-04T07:51:44.124270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.112105+0000","last_change":"2024-05-04T07:51:44.108334+0000","last_active":"2024-05-04T07:51:44.112105+0000","last_peered":"2024-05-04T07:51:44.112105+0000","last_clean":"2024-05-04T07:51:44.112105+0000","last_became_active":"2024-05-04T07:51:44.107321+0000","last_became_peered":"2024-05-04T07:51:44.107321+0000","last_unstale":"2024-05-04T07:51:44.112105+0000","last_undegraded":"2024-05-04T07:51:44.112105+0000","last_fullsized":"2024-05-04T07:51:44.112105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:16.186704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137047+0000","last_change":"2024-05-04T07:51:44.132446+0000","last_active":"2024-05-04T07:51:44.137047+0000","last_peered":"2024-05-04T07:51:44.137047+0000","last_clean":"2024-05-04T07:51:44.137047+0000","last_became_active":"2024-05-04T07:51:44.132149+0000","last_became_peered":"2024-05-04T07:51:44.132149+0000","last_unstale":"2024-05-04T07:51:44.137047+0000","last_undegraded":"2024-05-04T07:51:44.137047+0000","last_fullsized":"2024-05-04T07:51:44.137047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:02:21.231469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.112971+0000","last_change":"2024-05-04T07:51:44.109682+0000","last_active":"2024-05-04T07:51:44.112971+0000","last_peered":"2024-05-04T07:51:44.112971+0000","last_clean":"2024-05-04T07:51:44.112971+0000","last_became_active":"2024-05-04T07:51:44.109391+0000","last_became_peered":"2024-05-04T07:51:44.109391+0000","last_unstale":"2024-05-04T07:51:44.112971+0000","last_undegraded":"2024-05-04T07:51:44.112971+0000","last_fullsized":"2024-05-04T07:51:44.112971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:45.484062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121580+0000","last_change":"2024-05-04T07:51:44.117869+0000","last_active":"2024-05-04T07:51:44.121580+0000","last_peered":"2024-05-04T07:51:44.121580+0000","last_clean":"2024-05-04T07:51:44.121580+0000","last_became_active":"2024-05-04T07:51:44.117524+0000","last_became_peered":"2024-05-04T07:51:44.117524+0000","last_unstale":"2024-05-04T07:51:44.121580+0000","last_undegraded":"2024-05-04T07:51:44.121580+0000","last_fullsized":"2024-05-04T07:51:44.121580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.103280+0000","last_change":"2024-05-04T07:51:44.099234+0000","last_active":"2024-05-04T07:51:44.103280+0000","last_peered":"2024-05-04T07:51:44.103280+0000","last_clean":"2024-05-04T07:51:44.103280+0000","last_became_active":"2024-05-04T07:51:44.098157+0000","last_became_peered":"2024-05-04T07:51:44.098157+0000","last_unstale":"2024-05-04T07:51:44.103280+0000","last_undegraded":"2024-05-04T07:51:44.103280+0000","last_fullsized":"2024-05-04T07:51:44.103280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132846+0000","last_change":"2024-05-04T07:51:44.127320+0000","last_active":"2024-05-04T07:51:44.132846+0000","last_peered":"2024-05-04T07:51:44.132846+0000","last_clean":"2024-05-04T07:51:44.132846+0000","last_became_active":"2024-05-04T07:51:44.127089+0000","last_became_peered":"2024-05-04T07:51:44.127089+0000","last_unstale":"2024-05-04T07:51:44.132846+0000","last_undegraded":"2024-05-04T07:51:44.132846+0000","last_fullsized":"2024-05-04T07:51:44.132846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.125717+0000","last_change":"2024-05-04T07:51:44.120683+0000","last_active":"2024-05-04T07:51:44.125717+0000","last_peered":"2024-05-04T07:51:44.125717+0000","last_clean":"2024-05-04T07:51:44.125717+0000","last_became_active":"2024-05-04T07:51:44.120276+0000","last_became_peered":"2024-05-04T07:51:44.120276+0000","last_unstale":"2024-05-04T07:51:44.125717+0000","last_undegraded":"2024-05-04T07:51:44.125717+0000","last_fullsized":"2024-05-04T07:51:44.125717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.142808+0000","last_change":"2024-05-04T07:51:43.105658+0000","last_active":"2024-05-04T07:51:44.142808+0000","last_peered":"2024-05-04T07:51:44.142808+0000","last_clean":"2024-05-04T07:51:44.142808+0000","last_became_active":"2024-05-04T07:51:43.105343+0000","last_became_peered":"2024-05-04T07:51:43.105343+0000","last_unstale":"2024-05-04T07:51:44.142808+0000","last_undegraded":"2024-05-04T07:51:44.142808+0000","last_fullsized":"2024-05-04T07:51:44.142808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124477+0000","last_change":"2024-05-04T07:51:44.121029+0000","last_active":"2024-05-04T07:51:44.124477+0000","last_peered":"2024-05-04T07:51:44.124477+0000","last_clean":"2024-05-04T07:51:44.124477+0000","last_became_active":"2024-05-04T07:51:44.120740+0000","last_became_peered":"2024-05-04T07:51:44.120740+0000","last_unstale":"2024-05-04T07:51:44.124477+0000","last_undegraded":"2024-05-04T07:51:44.124477+0000","last_fullsized":"2024-05-04T07:51:44.124477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:52.972734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.142901+0000","last_change":"2024-05-04T07:51:43.116177+0000","last_active":"2024-05-04T07:51:44.142901+0000","last_peered":"2024-05-04T07:51:44.142901+0000","last_clean":"2024-05-04T07:51:44.142901+0000","last_became_active":"2024-05-04T07:51:43.115966+0000","last_became_peered":"2024-05-04T07:51:43.115966+0000","last_unstale":"2024-05-04T07:51:44.142901+0000","last_undegraded":"2024-05-04T07:51:44.142901+0000","last_fullsized":"2024-05-04T07:51:44.142901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:15.172789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127461+0000","last_change":"2024-05-04T07:51:44.116837+0000","last_active":"2024-05-04T07:51:44.127461+0000","last_peered":"2024-05-04T07:51:44.127461+0000","last_clean":"2024-05-04T07:51:44.127461+0000","last_became_active":"2024-05-04T07:51:44.116549+0000","last_became_peered":"2024-05-04T07:51:44.116549+0000","last_unstale":"2024-05-04T07:51:44.127461+0000","last_undegraded":"2024-05-04T07:51:44.127461+0000","last_fullsized":"2024-05-04T07:51:44.127461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:45.484062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135428+0000","last_change":"2024-05-04T07:51:43.109578+0000","last_active":"2024-05-04T07:51:44.135428+0000","last_peered":"2024-05-04T07:51:44.135428+0000","last_clean":"2024-05-04T07:51:44.135428+0000","last_became_active":"2024-05-04T07:51:43.109308+0000","last_became_peered":"2024-05-04T07:51:43.109308+0000","last_unstale":"2024-05-04T07:51:44.135428+0000","last_undegraded":"2024-05-04T07:51:44.135428+0000","last_fullsized":"2024-05-04T07:51:44.135428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141880+0000","last_change":"2024-05-04T07:51:44.136759+0000","last_active":"2024-05-04T07:51:44.141880+0000","last_peered":"2024-05-04T07:51:44.141880+0000","last_clean":"2024-05-04T07:51:44.141880+0000","last_became_active":"2024-05-04T07:51:44.136436+0000","last_became_peered":"2024-05-04T07:51:44.136436+0000","last_unstale":"2024-05-04T07:51:44.141880+0000","last_undegraded":"2024-05-04T07:51:44.141880+0000","last_fullsized":"2024-05-04T07:51:44.141880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:42:15.806425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144908+0000","last_change":"2024-05-04T07:51:43.102993+0000","last_active":"2024-05-04T07:51:44.144908+0000","last_peered":"2024-05-04T07:51:44.144908+0000","last_clean":"2024-05-04T07:51:44.144908+0000","last_became_active":"2024-05-04T07:51:43.102648+0000","last_became_peered":"2024-05-04T07:51:43.102648+0000","last_unstale":"2024-05-04T07:51:44.144908+0000","last_undegraded":"2024-05-04T07:51:44.144908+0000","last_fullsized":"2024-05-04T07:51:44.144908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:20:37.306500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140245+0000","last_change":"2024-05-04T07:51:44.135693+0000","last_active":"2024-05-04T07:51:44.140245+0000","last_peered":"2024-05-04T07:51:44.140245+0000","last_clean":"2024-05-04T07:51:44.140245+0000","last_became_active":"2024-05-04T07:51:44.134002+0000","last_became_peered":"2024-05-04T07:51:44.134002+0000","last_unstale":"2024-05-04T07:51:44.140245+0000","last_undegraded":"2024-05-04T07:51:44.140245+0000","last_fullsized":"2024-05-04T07:51:44.140245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140686+0000","last_change":"2024-05-04T07:51:43.112791+0000","last_active":"2024-05-04T07:51:44.140686+0000","last_peered":"2024-05-04T07:51:44.140686+0000","last_clean":"2024-05-04T07:51:44.140686+0000","last_became_active":"2024-05-04T07:51:43.112508+0000","last_became_peered":"2024-05-04T07:51:43.112508+0000","last_unstale":"2024-05-04T07:51:44.140686+0000","last_undegraded":"2024-05-04T07:51:44.140686+0000","last_fullsized":"2024-05-04T07:51:44.140686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.136909+0000","last_change":"2024-05-04T07:51:44.130638+0000","last_active":"2024-05-04T07:51:44.136909+0000","last_peered":"2024-05-04T07:51:44.136909+0000","last_clean":"2024-05-04T07:51:44.136909+0000","last_became_active":"2024-05-04T07:51:44.129894+0000","last_became_peered":"2024-05-04T07:51:44.129894+0000","last_unstale":"2024-05-04T07:51:44.136909+0000","last_undegraded":"2024-05-04T07:51:44.136909+0000","last_fullsized":"2024-05-04T07:51:44.136909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.134189+0000","last_change":"2024-05-04T07:51:43.114016+0000","last_active":"2024-05-04T07:51:44.134189+0000","last_peered":"2024-05-04T07:51:44.134189+0000","last_clean":"2024-05-04T07:51:44.134189+0000","last_became_active":"2024-05-04T07:51:43.113690+0000","last_became_peered":"2024-05-04T07:51:43.113690+0000","last_unstale":"2024-05-04T07:51:44.134189+0000","last_undegraded":"2024-05-04T07:51:44.134189+0000","last_fullsized":"2024-05-04T07:51:44.134189+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:55.994820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127670+0000","last_change":"2024-05-04T07:51:44.120663+0000","last_active":"2024-05-04T07:51:44.127670+0000","last_peered":"2024-05-04T07:51:44.127670+0000","last_clean":"2024-05-04T07:51:44.127670+0000","last_became_active":"2024-05-04T07:51:44.120217+0000","last_became_peered":"2024-05-04T07:51:44.120217+0000","last_unstale":"2024-05-04T07:51:44.127670+0000","last_undegraded":"2024-05-04T07:51:44.127670+0000","last_fullsized":"2024-05-04T07:51:44.127670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:57.008735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.108367+0000","last_change":"2024-05-04T07:51:43.114078+0000","last_active":"2024-05-04T07:51:44.108367+0000","last_peered":"2024-05-04T07:51:44.108367+0000","last_clean":"2024-05-04T07:51:44.108367+0000","last_became_active":"2024-05-04T07:51:43.113787+0000","last_became_peered":"2024-05-04T07:51:43.113787+0000","last_unstale":"2024-05-04T07:51:44.108367+0000","last_undegraded":"2024-05-04T07:51:44.108367+0000","last_fullsized":"2024-05-04T07:51:44.108367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:10.717165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138660+0000","last_change":"2024-05-04T07:51:44.120890+0000","last_active":"2024-05-04T07:51:44.138660+0000","last_peered":"2024-05-04T07:51:44.138660+0000","last_clean":"2024-05-04T07:51:44.138660+0000","last_became_active":"2024-05-04T07:51:44.120289+0000","last_became_peered":"2024-05-04T07:51:44.120289+0000","last_unstale":"2024-05-04T07:51:44.138660+0000","last_undegraded":"2024-05-04T07:51:44.138660+0000","last_fullsized":"2024-05-04T07:51:44.138660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105570+0000","last_change":"2024-05-04T07:51:43.103674+0000","last_active":"2024-05-04T07:51:44.105570+0000","last_peered":"2024-05-04T07:51:44.105570+0000","last_clean":"2024-05-04T07:51:44.105570+0000","last_became_active":"2024-05-04T07:51:43.103377+0000","last_became_peered":"2024-05-04T07:51:43.103377+0000","last_unstale":"2024-05-04T07:51:44.105570+0000","last_undegraded":"2024-05-04T07:51:44.105570+0000","last_fullsized":"2024-05-04T07:51:44.105570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.120345+0000","last_change":"2024-05-04T07:51:44.115510+0000","last_active":"2024-05-04T07:51:44.120345+0000","last_peered":"2024-05-04T07:51:44.120345+0000","last_clean":"2024-05-04T07:51:44.120345+0000","last_became_active":"2024-05-04T07:51:44.115022+0000","last_became_peered":"2024-05-04T07:51:44.115022+0000","last_unstale":"2024-05-04T07:51:44.120345+0000","last_undegraded":"2024-05-04T07:51:44.120345+0000","last_fullsized":"2024-05-04T07:51:44.120345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:51:36.500536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.104648+0000","last_change":"2024-05-04T07:51:43.103702+0000","last_active":"2024-05-04T07:51:44.104648+0000","last_peered":"2024-05-04T07:51:44.104648+0000","last_clean":"2024-05-04T07:51:44.104648+0000","last_became_active":"2024-05-04T07:51:43.103383+0000","last_became_peered":"2024-05-04T07:51:43.103383+0000","last_unstale":"2024-05-04T07:51:44.104648+0000","last_undegraded":"2024-05-04T07:51:44.104648+0000","last_fullsized":"2024-05-04T07:51:44.104648+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:28.503884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.117899+0000","last_change":"2024-05-04T07:51:44.114282+0000","last_active":"2024-05-04T07:51:44.117899+0000","last_peered":"2024-05-04T07:51:44.117899+0000","last_clean":"2024-05-04T07:51:44.117899+0000","last_became_active":"2024-05-04T07:51:44.113958+0000","last_became_peered":"2024-05-04T07:51:44.113958+0000","last_unstale":"2024-05-04T07:51:44.117899+0000","last_undegraded":"2024-05-04T07:51:44.117899+0000","last_fullsized":"2024-05-04T07:51:44.117899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:49.618954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.115728+0000","last_change":"2024-05-04T07:51:43.111342+0000","last_active":"2024-05-04T07:51:44.115728+0000","last_peered":"2024-05-04T07:51:44.115728+0000","last_clean":"2024-05-04T07:51:44.115728+0000","last_became_active":"2024-05-04T07:51:43.110352+0000","last_became_peered":"2024-05-04T07:51:43.110352+0000","last_unstale":"2024-05-04T07:51:44.115728+0000","last_undegraded":"2024-05-04T07:51:44.115728+0000","last_fullsized":"2024-05-04T07:51:44.115728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:14.118268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135618+0000","last_change":"2024-05-04T07:51:44.127934+0000","last_active":"2024-05-04T07:51:44.135618+0000","last_peered":"2024-05-04T07:51:44.135618+0000","last_clean":"2024-05-04T07:51:44.135618+0000","last_became_active":"2024-05-04T07:51:44.127676+0000","last_became_peered":"2024-05-04T07:51:44.127676+0000","last_unstale":"2024-05-04T07:51:44.135618+0000","last_undegraded":"2024-05-04T07:51:44.135618+0000","last_fullsized":"2024-05-04T07:51:44.135618+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.140989+0000","last_change":"2024-05-04T07:51:43.111648+0000","last_active":"2024-05-04T07:51:44.140989+0000","last_peered":"2024-05-04T07:51:44.140989+0000","last_clean":"2024-05-04T07:51:44.140989+0000","last_became_active":"2024-05-04T07:51:43.111308+0000","last_became_peered":"2024-05-04T07:51:43.111308+0000","last_unstale":"2024-05-04T07:51:44.140989+0000","last_undegraded":"2024-05-04T07:51:44.140989+0000","last_fullsized":"2024-05-04T07:51:44.140989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127694+0000","last_change":"2024-05-04T07:51:44.118554+0000","last_active":"2024-05-04T07:51:44.127694+0000","last_peered":"2024-05-04T07:51:44.127694+0000","last_clean":"2024-05-04T07:51:44.127694+0000","last_became_active":"2024-05-04T07:51:44.118228+0000","last_became_peered":"2024-05-04T07:51:44.118228+0000","last_unstale":"2024-05-04T07:51:44.127694+0000","last_undegraded":"2024-05-04T07:51:44.127694+0000","last_fullsized":"2024-05-04T07:51:44.127694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.147609+0000","last_change":"2024-05-04T07:51:43.110234+0000","last_active":"2024-05-04T07:51:44.147609+0000","last_peered":"2024-05-04T07:51:44.147609+0000","last_clean":"2024-05-04T07:51:44.147609+0000","last_became_active":"2024-05-04T07:51:43.108846+0000","last_became_peered":"2024-05-04T07:51:43.108846+0000","last_unstale":"2024-05-04T07:51:44.147609+0000","last_undegraded":"2024-05-04T07:51:44.147609+0000","last_fullsized":"2024-05-04T07:51:44.147609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:14.118268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.129169+0000","last_change":"2024-05-04T07:51:44.125099+0000","last_active":"2024-05-04T07:51:44.129169+0000","last_peered":"2024-05-04T07:51:44.129169+0000","last_clean":"2024-05-04T07:51:44.129169+0000","last_became_active":"2024-05-04T07:51:44.124324+0000","last_became_peered":"2024-05-04T07:51:44.124324+0000","last_unstale":"2024-05-04T07:51:44.129169+0000","last_undegraded":"2024-05-04T07:51:44.129169+0000","last_fullsized":"2024-05-04T07:51:44.129169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:13:11.731081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144349+0000","last_change":"2024-05-04T07:51:43.098221+0000","last_active":"2024-05-04T07:51:44.144349+0000","last_peered":"2024-05-04T07:51:44.144349+0000","last_clean":"2024-05-04T07:51:44.144349+0000","last_became_active":"2024-05-04T07:51:43.097947+0000","last_became_peered":"2024-05-04T07:51:43.097947+0000","last_unstale":"2024-05-04T07:51:44.144349+0000","last_undegraded":"2024-05-04T07:51:44.144349+0000","last_fullsized":"2024-05-04T07:51:44.144349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:51.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121447+0000","last_change":"2024-05-04T07:51:44.116327+0000","last_active":"2024-05-04T07:51:44.121447+0000","last_peered":"2024-05-04T07:51:44.121447+0000","last_clean":"2024-05-04T07:51:44.121447+0000","last_became_active":"2024-05-04T07:51:44.115982+0000","last_became_peered":"2024-05-04T07:51:44.115982+0000","last_unstale":"2024-05-04T07:51:44.121447+0000","last_undegraded":"2024-05-04T07:51:44.121447+0000","last_fullsized":"2024-05-04T07:51:44.121447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.109310+0000","last_change":"2024-05-04T07:51:43.113992+0000","last_active":"2024-05-04T07:51:44.109310+0000","last_peered":"2024-05-04T07:51:44.109310+0000","last_clean":"2024-05-04T07:51:44.109310+0000","last_became_active":"2024-05-04T07:51:43.113678+0000","last_became_peered":"2024-05-04T07:51:43.113678+0000","last_unstale":"2024-05-04T07:51:44.109310+0000","last_undegraded":"2024-05-04T07:51:44.109310+0000","last_fullsized":"2024-05-04T07:51:44.109310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:36.842655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.118181+0000","last_change":"2024-05-04T07:51:44.110572+0000","last_active":"2024-05-04T07:51:44.118181+0000","last_peered":"2024-05-04T07:51:44.118181+0000","last_clean":"2024-05-04T07:51:44.118181+0000","last_became_active":"2024-05-04T07:51:44.110266+0000","last_became_peered":"2024-05-04T07:51:44.110266+0000","last_unstale":"2024-05-04T07:51:44.118181+0000","last_undegraded":"2024-05-04T07:51:44.118181+0000","last_fullsized":"2024-05-04T07:51:44.118181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.090596+0000","last_change":"2024-05-04T07:51:43.104773+0000","last_active":"2024-05-04T07:51:44.090596+0000","last_peered":"2024-05-04T07:51:44.090596+0000","last_clean":"2024-05-04T07:51:44.090596+0000","last_became_active":"2024-05-04T07:51:43.104022+0000","last_became_peered":"2024-05-04T07:51:43.104022+0000","last_unstale":"2024-05-04T07:51:44.090596+0000","last_undegraded":"2024-05-04T07:51:44.090596+0000","last_fullsized":"2024-05-04T07:51:44.090596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:20:37.306500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138636+0000","last_change":"2024-05-04T07:51:44.120598+0000","last_active":"2024-05-04T07:51:44.138636+0000","last_peered":"2024-05-04T07:51:44.138636+0000","last_clean":"2024-05-04T07:51:44.138636+0000","last_became_active":"2024-05-04T07:51:44.119941+0000","last_became_peered":"2024-05-04T07:51:44.119941+0000","last_unstale":"2024-05-04T07:51:44.138636+0000","last_undegraded":"2024-05-04T07:51:44.138636+0000","last_fullsized":"2024-05-04T07:51:44.138636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:41:56.141260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137347+0000","last_change":"2024-05-04T07:51:43.114876+0000","last_active":"2024-05-04T07:51:44.137347+0000","last_peered":"2024-05-04T07:51:44.137347+0000","last_clean":"2024-05-04T07:51:44.137347+0000","last_became_active":"2024-05-04T07:51:43.114526+0000","last_became_peered":"2024-05-04T07:51:43.114526+0000","last_unstale":"2024-05-04T07:51:44.137347+0000","last_undegraded":"2024-05-04T07:51:44.137347+0000","last_fullsized":"2024-05-04T07:51:44.137347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:36.842655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130492+0000","last_change":"2024-05-04T07:51:44.117686+0000","last_active":"2024-05-04T07:51:44.130492+0000","last_peered":"2024-05-04T07:51:44.130492+0000","last_clean":"2024-05-04T07:51:44.130492+0000","last_became_active":"2024-05-04T07:51:44.117099+0000","last_became_peered":"2024-05-04T07:51:44.117099+0000","last_unstale":"2024-05-04T07:51:44.130492+0000","last_undegraded":"2024-05-04T07:51:44.130492+0000","last_fullsized":"2024-05-04T07:51:44.130492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144789+0000","last_change":"2024-05-04T07:51:43.116453+0000","last_active":"2024-05-04T07:51:44.144789+0000","last_peered":"2024-05-04T07:51:44.144789+0000","last_clean":"2024-05-04T07:51:44.144789+0000","last_became_active":"2024-05-04T07:51:43.115842+0000","last_became_peered":"2024-05-04T07:51:43.115842+0000","last_unstale":"2024-05-04T07:51:44.144789+0000","last_undegraded":"2024-05-04T07:51:44.144789+0000","last_fullsized":"2024-05-04T07:51:44.144789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:50:51.958819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137035+0000","last_change":"2024-05-04T07:51:44.130877+0000","last_active":"2024-05-04T07:51:44.137035+0000","last_peered":"2024-05-04T07:51:44.137035+0000","last_clean":"2024-05-04T07:51:44.137035+0000","last_became_active":"2024-05-04T07:51:44.130215+0000","last_became_peered":"2024-05-04T07:51:44.130215+0000","last_unstale":"2024-05-04T07:51:44.137035+0000","last_undegraded":"2024-05-04T07:51:44.137035+0000","last_fullsized":"2024-05-04T07:51:44.137035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:21:40.545437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.145205+0000","last_change":"2024-05-04T07:51:43.114381+0000","last_active":"2024-05-04T07:51:44.145205+0000","last_peered":"2024-05-04T07:51:44.145205+0000","last_clean":"2024-05-04T07:51:44.145205+0000","last_became_active":"2024-05-04T07:51:43.114095+0000","last_became_peered":"2024-05-04T07:51:43.114095+0000","last_unstale":"2024-05-04T07:51:44.145205+0000","last_undegraded":"2024-05-04T07:51:44.145205+0000","last_fullsized":"2024-05-04T07:51:44.145205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:03:15.172789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130934+0000","last_change":"2024-05-04T07:51:44.122317+0000","last_active":"2024-05-04T07:51:44.130934+0000","last_peered":"2024-05-04T07:51:44.130934+0000","last_clean":"2024-05-04T07:51:44.130934+0000","last_became_active":"2024-05-04T07:51:44.121851+0000","last_became_peered":"2024-05-04T07:51:44.121851+0000","last_unstale":"2024-05-04T07:51:44.130934+0000","last_undegraded":"2024-05-04T07:51:44.130934+0000","last_fullsized":"2024-05-04T07:51:44.130934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141354+0000","last_change":"2024-05-04T07:51:43.109580+0000","last_active":"2024-05-04T07:51:44.141354+0000","last_peered":"2024-05-04T07:51:44.141354+0000","last_clean":"2024-05-04T07:51:44.141354+0000","last_became_active":"2024-05-04T07:51:43.109191+0000","last_became_peered":"2024-05-04T07:51:43.109191+0000","last_unstale":"2024-05-04T07:51:44.141354+0000","last_undegraded":"2024-05-04T07:51:44.141354+0000","last_fullsized":"2024-05-04T07:51:44.141354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:12:17.305046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.132923+0000","last_change":"2024-05-04T07:51:44.127201+0000","last_active":"2024-05-04T07:51:44.132923+0000","last_peered":"2024-05-04T07:51:44.132923+0000","last_clean":"2024-05-04T07:51:44.132923+0000","last_became_active":"2024-05-04T07:51:44.126901+0000","last_became_peered":"2024-05-04T07:51:44.126901+0000","last_unstale":"2024-05-04T07:51:44.132923+0000","last_undegraded":"2024-05-04T07:51:44.132923+0000","last_fullsized":"2024-05-04T07:51:44.132923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:55:43.326770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.110434+0000","last_change":"2024-05-04T07:51:43.110995+0000","last_active":"2024-05-04T07:51:44.110434+0000","last_peered":"2024-05-04T07:51:44.110434+0000","last_clean":"2024-05-04T07:51:44.110434+0000","last_became_active":"2024-05-04T07:51:43.110555+0000","last_became_peered":"2024-05-04T07:51:43.110555+0000","last_unstale":"2024-05-04T07:51:44.110434+0000","last_undegraded":"2024-05-04T07:51:44.110434+0000","last_fullsized":"2024-05-04T07:51:44.110434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:46:55.994820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.116270+0000","last_change":"2024-05-04T07:51:44.109313+0000","last_active":"2024-05-04T07:51:44.116270+0000","last_peered":"2024-05-04T07:51:44.116270+0000","last_clean":"2024-05-04T07:51:44.116270+0000","last_became_active":"2024-05-04T07:51:44.108902+0000","last_became_peered":"2024-05-04T07:51:44.108902+0000","last_unstale":"2024-05-04T07:51:44.116270+0000","last_undegraded":"2024-05-04T07:51:44.116270+0000","last_fullsized":"2024-05-04T07:51:44.116270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.517799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.144039+0000","last_change":"2024-05-04T07:51:43.097502+0000","last_active":"2024-05-04T07:51:44.144039+0000","last_peered":"2024-05-04T07:51:44.144039+0000","last_clean":"2024-05-04T07:51:44.144039+0000","last_became_active":"2024-05-04T07:51:43.096940+0000","last_became_peered":"2024-05-04T07:51:43.096940+0000","last_unstale":"2024-05-04T07:51:44.144039+0000","last_undegraded":"2024-05-04T07:51:44.144039+0000","last_fullsized":"2024-05-04T07:51:44.144039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:22:05.577939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.133846+0000","last_change":"2024-05-04T07:51:44.127205+0000","last_active":"2024-05-04T07:51:44.133846+0000","last_peered":"2024-05-04T07:51:44.133846+0000","last_clean":"2024-05-04T07:51:44.133846+0000","last_became_active":"2024-05-04T07:51:44.126954+0000","last_became_peered":"2024-05-04T07:51:44.126954+0000","last_unstale":"2024-05-04T07:51:44.133846+0000","last_undegraded":"2024-05-04T07:51:44.133846+0000","last_fullsized":"2024-05-04T07:51:44.133846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:31:00.617548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.085297+0000","last_change":"2024-05-04T07:51:43.102471+0000","last_active":"2024-05-04T07:51:44.085297+0000","last_peered":"2024-05-04T07:51:44.085297+0000","last_clean":"2024-05-04T07:51:44.085297+0000","last_became_active":"2024-05-04T07:51:43.102136+0000","last_became_peered":"2024-05-04T07:51:43.102136+0000","last_unstale":"2024-05-04T07:51:44.085297+0000","last_undegraded":"2024-05-04T07:51:44.085297+0000","last_fullsized":"2024-05-04T07:51:44.085297+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:53:48.566384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.130175+0000","last_change":"2024-05-04T07:51:44.123232+0000","last_active":"2024-05-04T07:51:44.130175+0000","last_peered":"2024-05-04T07:51:44.130175+0000","last_clean":"2024-05-04T07:51:44.130175+0000","last_became_active":"2024-05-04T07:51:44.122556+0000","last_became_peered":"2024-05-04T07:51:44.122556+0000","last_unstale":"2024-05-04T07:51:44.130175+0000","last_undegraded":"2024-05-04T07:51:44.130175+0000","last_fullsized":"2024-05-04T07:51:44.130175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.092347+0000","last_change":"2024-05-04T07:51:43.108090+0000","last_active":"2024-05-04T07:51:44.092347+0000","last_peered":"2024-05-04T07:51:44.092347+0000","last_clean":"2024-05-04T07:51:44.092347+0000","last_became_active":"2024-05-04T07:51:43.107780+0000","last_became_peered":"2024-05-04T07:51:43.107780+0000","last_unstale":"2024-05-04T07:51:44.092347+0000","last_undegraded":"2024-05-04T07:51:44.092347+0000","last_fullsized":"2024-05-04T07:51:44.092347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:44.534989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.138679+0000","last_change":"2024-05-04T07:51:44.122172+0000","last_active":"2024-05-04T07:51:44.138679+0000","last_peered":"2024-05-04T07:51:44.138679+0000","last_clean":"2024-05-04T07:51:44.138679+0000","last_became_active":"2024-05-04T07:51:44.115805+0000","last_became_peered":"2024-05-04T07:51:44.115805+0000","last_unstale":"2024-05-04T07:51:44.138679+0000","last_undegraded":"2024-05-04T07:51:44.138679+0000","last_fullsized":"2024-05-04T07:51:44.138679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:54:17.379215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.086272+0000","last_change":"2024-05-04T07:51:43.096112+0000","last_active":"2024-05-04T07:51:44.086272+0000","last_peered":"2024-05-04T07:51:44.086272+0000","last_clean":"2024-05-04T07:51:44.086272+0000","last_became_active":"2024-05-04T07:51:43.095704+0000","last_became_peered":"2024-05-04T07:51:43.095704+0000","last_unstale":"2024-05-04T07:51:44.086272+0000","last_undegraded":"2024-05-04T07:51:44.086272+0000","last_fullsized":"2024-05-04T07:51:44.086272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:47:14.488687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.124452+0000","last_change":"2024-05-04T07:51:44.118386+0000","last_active":"2024-05-04T07:51:44.124452+0000","last_peered":"2024-05-04T07:51:44.124452+0000","last_clean":"2024-05-04T07:51:44.124452+0000","last_became_active":"2024-05-04T07:51:44.118138+0000","last_became_peered":"2024-05-04T07:51:44.118138+0000","last_unstale":"2024-05-04T07:51:44.124452+0000","last_undegraded":"2024-05-04T07:51:44.124452+0000","last_fullsized":"2024-05-04T07:51:44.124452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:42:15.132183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141138+0000","last_change":"2024-05-04T07:51:43.112887+0000","last_active":"2024-05-04T07:51:44.141138+0000","last_peered":"2024-05-04T07:51:44.141138+0000","last_clean":"2024-05-04T07:51:44.141138+0000","last_became_active":"2024-05-04T07:51:43.112585+0000","last_became_peered":"2024-05-04T07:51:43.112585+0000","last_unstale":"2024-05-04T07:51:44.141138+0000","last_undegraded":"2024-05-04T07:51:44.141138+0000","last_fullsized":"2024-05-04T07:51:44.141138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:34.397975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.121332+0000","last_change":"2024-05-04T07:51:44.116506+0000","last_active":"2024-05-04T07:51:44.121332+0000","last_peered":"2024-05-04T07:51:44.121332+0000","last_clean":"2024-05-04T07:51:44.121332+0000","last_became_active":"2024-05-04T07:51:44.115837+0000","last_became_peered":"2024-05-04T07:51:44.115837+0000","last_unstale":"2024-05-04T07:51:44.121332+0000","last_undegraded":"2024-05-04T07:51:44.121332+0000","last_fullsized":"2024-05-04T07:51:44.121332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:51:17.011577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.085596+0000","last_change":"2024-05-04T07:51:43.111836+0000","last_active":"2024-05-04T07:51:44.085596+0000","last_peered":"2024-05-04T07:51:44.085596+0000","last_clean":"2024-05-04T07:51:44.085596+0000","last_became_active":"2024-05-04T07:51:43.111548+0000","last_became_peered":"2024-05-04T07:51:43.111548+0000","last_unstale":"2024-05-04T07:51:44.085596+0000","last_undegraded":"2024-05-04T07:51:44.085596+0000","last_fullsized":"2024-05-04T07:51:44.085596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:22:23.750383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.141850+0000","last_change":"2024-05-04T07:51:44.136525+0000","last_active":"2024-05-04T07:51:44.141850+0000","last_peered":"2024-05-04T07:51:44.141850+0000","last_clean":"2024-05-04T07:51:44.141850+0000","last_became_active":"2024-05-04T07:51:44.124684+0000","last_became_peered":"2024-05-04T07:51:44.124684+0000","last_unstale":"2024-05-04T07:51:44.141850+0000","last_undegraded":"2024-05-04T07:51:44.141850+0000","last_fullsized":"2024-05-04T07:51:44.141850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:37:28.585868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.107607+0000","last_change":"2024-05-04T07:51:43.108916+0000","last_active":"2024-05-04T07:51:44.107607+0000","last_peered":"2024-05-04T07:51:44.107607+0000","last_clean":"2024-05-04T07:51:44.107607+0000","last_became_active":"2024-05-04T07:51:43.108616+0000","last_became_peered":"2024-05-04T07:51:43.108616+0000","last_unstale":"2024-05-04T07:51:44.107607+0000","last_undegraded":"2024-05-04T07:51:44.107607+0000","last_fullsized":"2024-05-04T07:51:44.107607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:19:56.458750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.129186+0000","last_change":"2024-05-04T07:51:44.125138+0000","last_active":"2024-05-04T07:51:44.129186+0000","last_peered":"2024-05-04T07:51:44.129186+0000","last_clean":"2024-05-04T07:51:44.129186+0000","last_became_active":"2024-05-04T07:51:44.124844+0000","last_became_peered":"2024-05-04T07:51:44.124844+0000","last_unstale":"2024-05-04T07:51:44.129186+0000","last_undegraded":"2024-05-04T07:51:44.129186+0000","last_fullsized":"2024-05-04T07:51:44.129186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:35:37.856570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.108889+0000","last_change":"2024-05-04T07:51:43.101476+0000","last_active":"2024-05-04T07:51:44.108889+0000","last_peered":"2024-05-04T07:51:44.108889+0000","last_clean":"2024-05-04T07:51:44.108889+0000","last_became_active":"2024-05-04T07:51:43.101097+0000","last_became_peered":"2024-05-04T07:51:43.101097+0000","last_unstale":"2024-05-04T07:51:44.108889+0000","last_undegraded":"2024-05-04T07:51:44.108889+0000","last_fullsized":"2024-05-04T07:51:44.108889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:48:44.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.135346+0000","last_change":"2024-05-04T07:51:44.128620+0000","last_active":"2024-05-04T07:51:44.135346+0000","last_peered":"2024-05-04T07:51:44.135346+0000","last_clean":"2024-05-04T07:51:44.135346+0000","last_became_active":"2024-05-04T07:51:44.128336+0000","last_became_peered":"2024-05-04T07:51:44.128336+0000","last_unstale":"2024-05-04T07:51:44.135346+0000","last_undegraded":"2024-05-04T07:51:44.135346+0000","last_fullsized":"2024-05-04T07:51:44.135346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T18:37:47.261472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.090319+0000","last_change":"2024-05-04T07:51:43.100879+0000","last_active":"2024-05-04T07:51:44.090319+0000","last_peered":"2024-05-04T07:51:44.090319+0000","last_clean":"2024-05-04T07:51:44.090319+0000","last_became_active":"2024-05-04T07:51:43.098113+0000","last_became_peered":"2024-05-04T07:51:43.098113+0000","last_unstale":"2024-05-04T07:51:44.090319+0000","last_undegraded":"2024-05-04T07:51:44.090319+0000","last_fullsized":"2024-05-04T07:51:44.090319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:25:00.872110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.127731+0000","last_change":"2024-05-04T07:51:44.120880+0000","last_active":"2024-05-04T07:51:44.127731+0000","last_peered":"2024-05-04T07:51:44.127731+0000","last_clean":"2024-05-04T07:51:44.127731+0000","last_became_active":"2024-05-04T07:51:44.120454+0000","last_became_peered":"2024-05-04T07:51:44.120454+0000","last_unstale":"2024-05-04T07:51:44.127731+0000","last_undegraded":"2024-05-04T07:51:44.127731+0000","last_fullsized":"2024-05-04T07:51:44.127731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:17:45.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.105301+0000","last_change":"2024-05-04T07:51:43.104834+0000","last_active":"2024-05-04T07:51:44.105301+0000","last_peered":"2024-05-04T07:51:44.105301+0000","last_clean":"2024-05-04T07:51:44.105301+0000","last_became_active":"2024-05-04T07:51:43.104541+0000","last_became_peered":"2024-05-04T07:51:43.104541+0000","last_unstale":"2024-05-04T07:51:44.105301+0000","last_undegraded":"2024-05-04T07:51:44.105301+0000","last_fullsized":"2024-05-04T07:51:44.105301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T16:25:00.872110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.118088+0000","last_change":"2024-05-04T07:51:44.110330+0000","last_active":"2024-05-04T07:51:44.118088+0000","last_peered":"2024-05-04T07:51:44.118088+0000","last_clean":"2024-05-04T07:51:44.118088+0000","last_became_active":"2024-05-04T07:51:44.109867+0000","last_became_peered":"2024-05-04T07:51:44.109867+0000","last_unstale":"2024-05-04T07:51:44.118088+0000","last_undegraded":"2024-05-04T07:51:44.118088+0000","last_fullsized":"2024-05-04T07:51:44.118088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T19:39:35.411890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.096967+0000","last_change":"2024-05-04T07:51:43.103048+0000","last_active":"2024-05-04T07:51:44.096967+0000","last_peered":"2024-05-04T07:51:44.096967+0000","last_clean":"2024-05-04T07:51:44.096967+0000","last_became_active":"2024-05-04T07:51:43.102722+0000","last_became_peered":"2024-05-04T07:51:43.102722+0000","last_unstale":"2024-05-04T07:51:44.096967+0000","last_undegraded":"2024-05-04T07:51:44.096967+0000","last_fullsized":"2024-05-04T07:51:44.096967+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.137006+0000","last_change":"2024-05-04T07:51:44.131838+0000","last_active":"2024-05-04T07:51:44.137006+0000","last_peered":"2024-05-04T07:51:44.137006+0000","last_clean":"2024-05-04T07:51:44.137006+0000","last_became_active":"2024-05-04T07:51:44.131567+0000","last_became_peered":"2024-05-04T07:51:44.131567+0000","last_unstale":"2024-05-04T07:51:44.137006+0000","last_undegraded":"2024-05-04T07:51:44.137006+0000","last_fullsized":"2024-05-04T07:51:44.137006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:43.057974+0000","last_clean_scrub_stamp":"2024-05-04T07:51:43.057974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:37:28.585868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.095659+0000","last_change":"2024-05-04T07:51:43.115299+0000","last_active":"2024-05-04T07:51:44.095659+0000","last_peered":"2024-05-04T07:51:44.095659+0000","last_clean":"2024-05-04T07:51:44.095659+0000","last_became_active":"2024-05-04T07:51:43.114671+0000","last_became_peered":"2024-05-04T07:51:43.114671+0000","last_unstale":"2024-05-04T07:51:44.095659+0000","last_undegraded":"2024-05-04T07:51:44.095659+0000","last_fullsized":"2024-05-04T07:51:44.095659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:51:42.044058+0000","last_clean_scrub_stamp":"2024-05-04T07:51:42.044058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:30:59.603633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":144,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-04T07:51:44.088188+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:51:44.088188+0000","last_peered":"2024-05-04T07:51:44.088188+0000","last_clean":"2024-05-04T07:51:44.088188+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:51:44.088188+0000","last_undegraded":"2024-05-04T07:51:44.088188+0000","last_fullsized":"2024-05-04T07:51:44.088188+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1019904,"data_stored":772406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":182038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1032192,"data_stored":779573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:51:49.033 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T07:51:49.034 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-04T07:51:49.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.286+0000 7f0607200640 1 Processor -- start 2024-05-04T07:51:49.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.286+0000 7f0607200640 1 -- start start 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0607200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f060815f2a0 0x7f06080b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0607200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f06080b6760 0x7f06080cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0607200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06080b1b90 con 0x7f060815f680 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0607200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f06080b2d00 con 0x7f060815f2a0 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0607200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f060806c4d0 con 0x7f06080b6760 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0605e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f060815f2a0 0x7f06080b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0605e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f060815f2a0 0x7f06080b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54034/0 (socket says 172.21.15.136:54034) 2024-05-04T07:51:49.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.287+0000 7f0605e00640 1 -- 172.21.15.136:0/800439171 learned_addr learned my addr 172.21.15.136:0/800439171 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.288+0000 7f0605e00640 1 -- 172.21.15.136:0/800439171 >> v2:172.21.15.142:3300/0 conn(0x7f06080b6760 msgr2=0x7f06080cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.288+0000 7f0606800640 1 --2- 172.21.15.136:0/800439171 >> v2:172.21.15.142:3300/0 conn(0x7f06080b6760 0x7f06080cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.288+0000 7f0605e00640 1 --2- 172.21.15.136:0/800439171 >> v2:172.21.15.142:3300/0 conn(0x7f06080b6760 0x7f06080cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.288+0000 7f0605e00640 1 -- 172.21.15.136:0/800439171 >> v1:172.21.15.142:6789/0 conn(0x7f060815f680 legacy=0x7f06080b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.288+0000 7f0605e00640 1 -- 172.21.15.136:0/800439171 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060806c7b0 con 0x7f060815f2a0 2024-05-04T07:51:49.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.289+0000 7f0605e00640 1 --2- 172.21.15.136:0/800439171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060815f2a0 0x7f06080b27c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06080cb980 tx=0x7f05f802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc460d0a44eef2d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.289+0000 7f0604a00640 1 -- 172.21.15.136:0/800439171 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8037070 con 0x7f060815f2a0 2024-05-04T07:51:49.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.289+0000 7f0604a00640 1 -- 172.21.15.136:0/800439171 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f8032440 con 0x7f060815f2a0 2024-05-04T07:51:49.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.289+0000 7f0604a00640 1 -- 172.21.15.136:0/800439171 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8032810 con 0x7f060815f2a0 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 -- 172.21.15.136:0/800439171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060815f2a0 msgr2=0x7f06080b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 --2- 172.21.15.136:0/800439171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060815f2a0 0x7f06080b27c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06080cb980 tx=0x7f05f802a140 comp rx=0 tx=0).stop 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 -- 172.21.15.136:0/800439171 shutdown_connections 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 --2- 172.21.15.136:0/800439171 >> v2:172.21.15.142:3300/0 conn(0x7f06080b6760 0x7f06080cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 --2- 172.21.15.136:0/800439171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060815f2a0 0x7f06080b27c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 -- 172.21.15.136:0/800439171 >> 172.21.15.136:0/800439171 conn(0x7f06080739e0 msgr2=0x7f0608073df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 -- 172.21.15.136:0/800439171 shutdown_connections 2024-05-04T07:51:49.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.290+0000 7f0607200640 1 -- 172.21.15.136:0/800439171 wait complete. 2024-05-04T07:51:49.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.291+0000 7f0607200640 1 Processor -- start 2024-05-04T07:51:49.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 -- start start 2024-05-04T07:51:49.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f060815f2a0 0x7f06080ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f060815f680 0x7f0608154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f060806ca90 con 0x7f06080b6760 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f06080b2320 con 0x7f060815f680 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.292+0000 7f0607200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f060806cc10 con 0x7f060815f2a0 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54048/0 (socket says 172.21.15.136:54048) 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 -- 172.21.15.136:0/359377883 learned_addr learned my addr 172.21.15.136:0/359377883 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 -- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f060815f2a0 msgr2=0x7f06080ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f060815f2a0 0x7f06080ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 -- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f060815f680 msgr2=0x7f0608154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f060815f680 0x7f0608154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 -- 172.21.15.136:0/359377883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06081546a0 con 0x7f06080b6760 2024-05-04T07:51:49.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.293+0000 7f0605e00640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f05f8000c00 tx=0x7f05f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.294+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8041020 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.294+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f8030970 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.294+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060815d650 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.294+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8037040 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.294+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081f8810 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.295+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0608069b10 con 0x7f06080b6760 2024-05-04T07:51:49.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.296+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f05f8044020 con 0x7f06080b6760 2024-05-04T07:51:49.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.297+0000 7f05fe000640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 0x7f05e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.297+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f05f80b81c0 con 0x7f06080b6760 2024-05-04T07:51:49.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.297+0000 7f0605400640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 0x7f05e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.298+0000 7f0605400640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 0x7f05e4078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06081f83f0 tx=0x7f05f0009250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.301+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05f804b030 con 0x7f06080b6760 2024-05-04T07:51:49.580 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.578+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f060815e8c0 con 0x7f06080b6760 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.583+0000 7f05fe000640 1 -- 172.21.15.136:0/359377883 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f05f8081980 con 0x7f06080b6760 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB+6DVmlFbsFBAAIn9GcuvztIqP7lCKmms1KA== 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: caps mds = "allow" 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: caps mon = "allow r" 2024-05-04T07:51:49.585 INFO:teuthology.orchestra.run.smithi136.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-04T07:51:49.586 INFO:teuthology.orchestra.run.smithi136.stderr:updated caps for client.0 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 msgr2=0x7f05e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 0x7f05e4078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06081f83f0 tx=0x7f05f0009250 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 msgr2=0x7f060815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f05f8000c00 tx=0x7f05f80046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 shutdown_connections 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f05e40762d0 0x7f05e4078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f060815f680 0x7f0608154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f060815f2a0 0x7f06080ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 --2- 172.21.15.136:0/359377883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f06080b6760 0x7f060815d900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 >> 172.21.15.136:0/359377883 conn(0x7f06080739e0 msgr2=0x7f06080aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 shutdown_connections 2024-05-04T07:51:49.589 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.587+0000 7f0607200640 1 -- 172.21.15.136:0/359377883 wait complete. 2024-05-04T07:51:49.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:51:49.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.805+0000 7f8289400640 1 Processor -- start 2024-05-04T07:51:49.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.805+0000 7f8289400640 1 -- start start 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 0x7f82840d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 0x7f82840d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82840b49e0 0x7f82840b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f82840d3d80 con 0x7f82840b49e0 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f82840b2170 con 0x7f82840b1c60 2024-05-04T07:51:49.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.806+0000 7f8289400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f82840b2430 con 0x7f82840d3460 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82840b49e0 0x7f82840b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f82840b49e0 0x7f82840b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54050/0 (socket says 172.21.15.136:54050) 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 -- 172.21.15.136:0/1045352560 learned_addr learned my addr 172.21.15.136:0/1045352560 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f827b400640 1 --2- 172.21.15.136:0/1045352560 >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 0x7f82840d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8283e00640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 0x7f82840d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 -- 172.21.15.136:0/1045352560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 msgr2=0x7f82840d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 0x7f82840d3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 -- 172.21.15.136:0/1045352560 >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 msgr2=0x7f82840d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:49.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 --2- 172.21.15.136:0/1045352560 >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 0x7f82840d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8288a00640 1 -- 172.21.15.136:0/1045352560 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82840b2710 con 0x7f82840b49e0 2024-05-04T07:51:49.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f827b400640 1 --2- 172.21.15.136:0/1045352560 >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 0x7f82840d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:49.810 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.807+0000 7f8283e00640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 0x7f82840d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.808+0000 7f8288a00640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f82840b4e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f828406f4e0 tx=0x7f827c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1359e06015cc5140 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.809+0000 7f8283400640 1 -- 172.21.15.136:0/1045352560 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c036070 con 0x7f82840b49e0 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.809+0000 7f8283400640 1 -- 172.21.15.136:0/1045352560 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c031600 con 0x7f82840b49e0 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.809+0000 7f8283400640 1 -- 172.21.15.136:0/1045352560 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c0319d0 con 0x7f82840b49e0 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.809+0000 7f8289400640 1 -- 172.21.15.136:0/1045352560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 msgr2=0x7f82840b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.809+0000 7f8289400640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f82840b4e90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f828406f4e0 tx=0x7f827c02a610 comp rx=0 tx=0).stop 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 -- 172.21.15.136:0/1045352560 shutdown_connections 2024-05-04T07:51:49.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f82840b4e90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 --2- 172.21.15.136:0/1045352560 >> v2:172.21.15.142:3300/0 conn(0x7f82840b1c60 0x7f82840d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 --2- 172.21.15.136:0/1045352560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840d3460 0x7f82840d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 -- 172.21.15.136:0/1045352560 >> 172.21.15.136:0/1045352560 conn(0x7f828409e370 msgr2=0x7f82840d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 -- 172.21.15.136:0/1045352560 shutdown_connections 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.810+0000 7f8289400640 1 -- 172.21.15.136:0/1045352560 wait complete. 2024-05-04T07:51:49.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.811+0000 7f8289400640 1 Processor -- start 2024-05-04T07:51:49.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.811+0000 7f8289400640 1 -- start start 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840b1c60 0x7f828415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82840d3460 0x7f82840ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82840d5f00 con 0x7f82840b49e0 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82840b2cd0 con 0x7f82840d3460 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.812+0000 7f8289400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8284163ae0 con 0x7f82840b1c60 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54062/0 (socket says 172.21.15.136:54062) 2024-05-04T07:51:49.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 -- 172.21.15.136:0/2899424162 learned_addr learned my addr 172.21.15.136:0/2899424162 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f8283e00640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840b1c60 0x7f828415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f8288a00640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82840d3460 0x7f82840ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 -- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840b1c60 msgr2=0x7f828415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840b1c60 0x7f828415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 -- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82840d3460 msgr2=0x7f82840ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82840d3460 0x7f82840ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 -- 172.21.15.136:0/2899424162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82840c8f90 con 0x7f82840b49e0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.813+0000 7f827b400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c820 tx=0x7f826c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.814+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c004230 con 0x7f82840b49e0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.814+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0043f0 con 0x7f82840b49e0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.814+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c007a70 con 0x7f82840b49e0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.814+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82840c9270 con 0x7f82840b49e0 2024-05-04T07:51:49.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.814+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82840c9830 con 0x7f82840b49e0 2024-05-04T07:51:49.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.815+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8284069b10 con 0x7f82840b49e0 2024-05-04T07:51:49.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.816+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f826c007c10 con 0x7f82840b49e0 2024-05-04T07:51:49.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.817+0000 7f8280c00640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 0x7f8260078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:49.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.817+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f826c097970 con 0x7f82840b49e0 2024-05-04T07:51:49.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.817+0000 7f8283e00640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 0x7f8260078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:49.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.818+0000 7f8283e00640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 0x7f8260078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f827400b840 tx=0x7f8274008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:49.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:49.822+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8284069b10 con 0x7f82840b49e0 2024-05-04T07:51:50.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.076+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8284074600 con 0x7f82840b49e0 2024-05-04T07:51:50.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.077+0000 7f8280c00640 1 -- 172.21.15.136:0/2899424162 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7f8284074600 con 0x7f82840b49e0 2024-05-04T07:51:50.078 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:50.078 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:51:50.079 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:51:50.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 msgr2=0x7f8260078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 0x7f8260078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f827400b840 tx=0x7f8274008040 comp rx=0 tx=0).stop 2024-05-04T07:51:50.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 msgr2=0x7f828415e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.081 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c820 tx=0x7f826c00cce0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 shutdown_connections 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82600762d0 0x7f8260078790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82840d3460 0x7f82840ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82840b49e0 0x7f828415e600 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 --2- 172.21.15.136:0/2899424162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82840b1c60 0x7f828415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.079+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 >> 172.21.15.136:0/2899424162 conn(0x7f828409e370 msgr2=0x7f82840b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.080+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 shutdown_connections 2024-05-04T07:51:50.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.080+0000 7f8289400640 1 -- 172.21.15.136:0/2899424162 wait complete. 2024-05-04T07:51:50.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-04T07:51:43.553260+0000', 'modified': '2024-05-04T07:51:46.592685+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4884': {'gid': 4884, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.136:6837/2426434001', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2426434001}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2426434001}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4884, 'qdb_cluster': [4884]} 2024-05-04T07:51:50.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-04T07:51:50.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-04T07:51:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.714+0000 7f4d45e00640 1 Processor -- start 2024-05-04T07:51:50.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.715+0000 7f4d45e00640 1 -- start start 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d45e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4d40071ed0 0x7f4d400cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cb7b0 0x7f4d4006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d45e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d400ced70 con 0x7f4d400ce820 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d45e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4d400c45c0 con 0x7f4d40071ed0 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d45e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d400cf050 con 0x7f4d400cb7b0 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d3ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4d40071ed0 0x7f4d400cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d3e000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4d400ce820 0x7f4d400722b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:48772/0 (socket says 172.21.15.136:48772) 2024-05-04T07:51:50.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.716+0000 7f4d3e000640 1 -- 172.21.15.136:0/52266588 learned_addr learned my addr 172.21.15.136:0/52266588 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3ea00640 1 -- 172.21.15.136:0/52266588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cb7b0 msgr2=0x7f4d4006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3f400640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cb7b0 0x7f4d4006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cb7b0 0x7f4d4006dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3ea00640 1 -- 172.21.15.136:0/52266588 >> v1:172.21.15.136:6789/0 conn(0x7f4d400ce820 legacy=0x7f4d400722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3ea00640 1 -- 172.21.15.136:0/52266588 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d400cf330 con 0x7f4d40071ed0 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.717+0000 7f4d3d600640 1 -- 172.21.15.136:0/52266588 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84738344 0 0) 0x7f4d400ced70 con 0x7f4d400ce820 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.718+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40071ed0 0x7f4d400cfe10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4d300097d0 tx=0x7f4d3002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325ee61c9f2fd0b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.718+0000 7f4d3d600640 1 -- 172.21.15.136:0/52266588 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30037070 con 0x7f4d40071ed0 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.718+0000 7f4d3d600640 1 -- 172.21.15.136:0/52266588 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d30032440 con 0x7f4d40071ed0 2024-05-04T07:51:50.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.718+0000 7f4d3d600640 1 -- 172.21.15.136:0/52266588 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30032810 con 0x7f4d40071ed0 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 -- 172.21.15.136:0/52266588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40071ed0 msgr2=0x7f4d400cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40071ed0 0x7f4d400cfe10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4d300097d0 tx=0x7f4d3002a1c0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 -- 172.21.15.136:0/52266588 shutdown_connections 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cb7b0 0x7f4d4006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 --2- 172.21.15.136:0/52266588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d40071ed0 0x7f4d400cfe10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 -- 172.21.15.136:0/52266588 >> 172.21.15.136:0/52266588 conn(0x7f4d400d0c50 msgr2=0x7f4d400d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 -- 172.21.15.136:0/52266588 shutdown_connections 2024-05-04T07:51:50.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.719+0000 7f4d45e00640 1 -- 172.21.15.136:0/52266588 wait complete. 2024-05-04T07:51:50.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.721+0000 7f4d45e00640 1 Processor -- start 2024-05-04T07:51:50.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.721+0000 7f4d45e00640 1 -- start start 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d40071ed0 0x7f4d40162a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400ce820 0x7f4d400b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40166e00 con 0x7f4d400cb7b0 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d400cf8f0 con 0x7f4d40071ed0 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d45e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d400d08c0 con 0x7f4d400ce820 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54076/0 (socket says 172.21.15.136:54076) 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 -- 172.21.15.136:0/569785746 learned_addr learned my addr 172.21.15.136:0/569785746 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d40071ed0 0x7f4d40162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3f400640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400ce820 0x7f4d400b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 -- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400ce820 msgr2=0x7f4d400b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400ce820 0x7f4d400b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 -- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d40071ed0 msgr2=0x7f4d40162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.722+0000 7f4d3e000640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d40071ed0 0x7f4d40162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d3e000640 1 -- 172.21.15.136:0/569785746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d400b38f0 con 0x7f4d400cb7b0 2024-05-04T07:51:50.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d3e000640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c770 tx=0x7f4d2800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d37400640 1 -- 172.21.15.136:0/569785746 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28018070 con 0x7f4d400cb7b0 2024-05-04T07:51:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d37400640 1 -- 172.21.15.136:0/569785746 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2800a640 con 0x7f4d400cb7b0 2024-05-04T07:51:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d37400640 1 -- 172.21.15.136:0/569785746 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800aa30 con 0x7f4d400cb7b0 2024-05-04T07:51:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d400b3bd0 con 0x7f4d400cb7b0 2024-05-04T07:51:50.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.723+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d400b4190 con 0x7f4d400cb7b0 2024-05-04T07:51:50.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.726+0000 7f4d37400640 1 -- 172.21.15.136:0/569785746 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d2800abd0 con 0x7f4d400cb7b0 2024-05-04T07:51:50.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.727+0000 7f4d37400640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 0x7f4d1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.728 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.727+0000 7f4d37400640 1 -- 172.21.15.136:0/569785746 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4d28096e10 con 0x7f4d400cb7b0 2024-05-04T07:51:50.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.727+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 0x7f4d1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.727+0000 7f4d48d76740 1 Processor -- start 2024-05-04T07:51:50.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.727+0000 7f4d48d76740 1 -- start start 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 0x7f4d1c078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d30034000 tx=0x7f4d3002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6c86d0 0x55ba1d6cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d6cc980 0x55ba1d6ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d631790 con 0x55ba1d6cd840 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d5d6f20 con 0x55ba1d6cc980 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ba1d62d750 con 0x55ba1d6c86d0 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.728+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54082/0 (socket says 172.21.15.136:54082) 2024-05-04T07:51:50.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 -- 172.21.15.136:0/2435650657 learned_addr learned my addr 172.21.15.136:0/2435650657 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 -- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6c86d0 msgr2=0x55ba1d6cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.732 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6c86d0 0x55ba1d6cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 -- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d6cc980 msgr2=0x55ba1d6ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d6cc980 0x55ba1d6ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 -- 172.21.15.136:0/2435650657 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1d3432d0 con 0x55ba1d6cd840 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.729+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a200 tx=0x7f4d3002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d15ae6dc0be589 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d2f400640 1 -- 172.21.15.136:0/2435650657 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3004d070 con 0x55ba1d6cd840 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d2f400640 1 -- 172.21.15.136:0/2435650657 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3003d470 con 0x55ba1d6cd840 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d2f400640 1 -- 172.21.15.136:0/2435650657 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30037040 con 0x55ba1d6cd840 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 -- 172.21.15.136:0/2435650657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 msgr2=0x55ba1d6cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d3002a200 tx=0x7f4d3002c000 comp rx=0 tx=0).stop 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 -- 172.21.15.136:0/2435650657 shutdown_connections 2024-05-04T07:51:50.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d6cc980 0x55ba1d6ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6c86d0 0x55ba1d6cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 --2- 172.21.15.136:0/2435650657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d6cdc20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.730+0000 7f4d48d76740 1 -- 172.21.15.136:0/2435650657 >> 172.21.15.136:0/2435650657 conn(0x55ba1d6ca940 msgr2=0x55ba1d713400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.731+0000 7f4d48d76740 1 -- 172.21.15.136:0/2435650657 shutdown_connections 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.731+0000 7f4d48d76740 1 -- 172.21.15.136:0/2435650657 wait complete. 2024-05-04T07:51:50.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.731+0000 7f4d48d76740 1 -- start start 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.732+0000 7f4d48d76740 1 Processor -- start 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.732+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d6e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d716410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d6f93d0 con 0x55ba1d6cd840 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d5ea9c0 con 0x55ba1d715f90 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ba1d6f8850 con 0x55ba1d6cc980 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d48d76740 10 client.0 _ll_register_callbacks cb 0x55ba1d5b7120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54096/0 (socket says 172.21.15.136:54096) 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 -- 172.21.15.136:0/1802847701 learned_addr learned my addr 172.21.15.136:0/1802847701 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 -- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 msgr2=0x55ba1d6e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d6e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 -- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 msgr2=0x55ba1d716410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3f400640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d716410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d716410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3e000640 1 -- 172.21.15.136:0/1802847701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba1d40d6b0 con 0x55ba1d6cd840 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.733+0000 7f4d3f400640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d716410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d3e000640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d2805bf50 tx=0x7f4d2805f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7b6e5c6f2a0bca server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2805fed0 con 0x55ba1d6cd840 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4d2805b840 con 0x55ba1d6cd840 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3003d470 con 0x55ba1d6cd840 2024-05-04T07:51:50.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d28064280 con 0x55ba1d6cd840 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d48d76740 10 client.5040 fetch_fsmap learned FSMap version 19 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ba1d719430 con 0x55ba1d6cd840 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3003d470 con 0x55ba1d6cd840 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4d2805eba0 con 0x55ba1d6cd840 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.734+0000 7f4d48d76740 10 client.5040 fetch_fsmap finished waiting for FSMap version 19 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d48d76740 10 client.5040 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d48d76740 20 client.5040 populate_metadata read hostname 'smithi136' 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d719dd0 0x55ba1d71a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d48d76740 4 client.5040 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 --> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba1d63f3a0 con 0x55ba1d719dd0 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d719dd0 0x55ba1d71a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d27e00640 10 client.5040 ms_handle_connect on v2:172.21.15.136:6836/2426434001 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.735+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d719dd0 0x55ba1d71a1b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0545df14478d06f server_cookie=58203e0c7913b61b in_seq=0 out_seq=0 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.736+0000 7f4d27e00640 1 -- 172.21.15.136:0/1802847701 <== mds.0 v2:172.21.15.136:6836/2426434001 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba1d63f3a0 con 0x55ba1d719dd0 2024-05-04T07:51:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d27e00640 10 client.5040 handle_command_reply: tid=0 2024-05-04T07:51:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 client.5040 shutdown 2024-05-04T07:51:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 msgr2=0x55ba1d71b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d2805bf50 tx=0x7f4d2805f700 comp rx=0 tx=0).stop 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 shutdown_connections 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d719dd0 0x55ba1d71a1b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d716410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d71b4f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1802847701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d6e9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d27e00640 0 client.5040 ms_handle_reset on v2:172.21.15.136:6836/2426434001 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 >> 172.21.15.136:0/1802847701 conn(0x55ba1d6c86d0 msgr2=0x55ba1d6c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 shutdown_connections 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 1 -- 172.21.15.136:0/1802847701 wait complete. 2024-05-04T07:51:50.742 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.737+0000 7f4d48d76740 20 client.5040 trim_cache size 0 max 16384 2024-05-04T07:51:50.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.758+0000 7f4d48d76740 1 Processor -- start 2024-05-04T07:51:50.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.758+0000 7f4d48d76740 1 -- start start 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cd840 0x55ba1d6cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4d402050a0 con 0x55ba1d6cc980 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d400b1a80 con 0x55ba1d715f90 2024-05-04T07:51:50.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d40204ab0 con 0x55ba1d6cd840 2024-05-04T07:51:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54110/0 (socket says 172.21.15.136:54110) 2024-05-04T07:51:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 -- 172.21.15.136:0/1012472581 learned_addr learned my addr 172.21.15.136:0/1012472581 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 -- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cd840 msgr2=0x55ba1d6cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cd840 0x55ba1d6cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 -- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 msgr2=0x55ba1d6f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3f400640 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.759+0000 7f4d3ea00640 1 -- 172.21.15.136:0/1012472581 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1d7178e0 con 0x55ba1d6cc980 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.760+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098f0 tx=0x7f4d3003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea34fce1d0bc400e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.760+0000 7f4d2ea00640 1 -- 172.21.15.136:0/1012472581 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3004d040 con 0x55ba1d6cc980 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.760+0000 7f4d2ea00640 1 -- 172.21.15.136:0/1012472581 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d30054740 con 0x55ba1d6cc980 2024-05-04T07:51:50.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.760+0000 7f4d2ea00640 1 -- 172.21.15.136:0/1012472581 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30054af0 con 0x55ba1d6cc980 2024-05-04T07:51:50.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- 172.21.15.136:0/1012472581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 msgr2=0x55ba1d6f7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d300098f0 tx=0x7f4d3003b000 comp rx=0 tx=0).stop 2024-05-04T07:51:50.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- 172.21.15.136:0/1012472581 shutdown_connections 2024-05-04T07:51:50.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cd840 0x55ba1d6cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 --2- 172.21.15.136:0/1012472581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cc980 0x55ba1d6f7870 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- 172.21.15.136:0/1012472581 >> 172.21.15.136:0/1012472581 conn(0x55ba1d6c86d0 msgr2=0x55ba1d6ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- 172.21.15.136:0/1012472581 shutdown_connections 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- 172.21.15.136:0/1012472581 wait complete. 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.761+0000 7f4d48d76740 1 -- start start 2024-05-04T07:51:50.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.762+0000 7f4d48d76740 1 Processor -- start 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d7374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d723560 con 0x55ba1d6cd840 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ba1d71ba30 con 0x55ba1d715f90 2024-05-04T07:51:50.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55ba1d718350 con 0x55ba1d6cc980 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d48d76740 10 client.0 _ll_register_callbacks cb 0x7f4d2800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54118/0 (socket says 172.21.15.136:54118) 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 -- 172.21.15.136:0/529376079 learned_addr learned my addr 172.21.15.136:0/529376079 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 -- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 msgr2=0x55ba1d7374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d7374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d7374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 -- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 msgr2=0x55ba1d6f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.763+0000 7f4d3e000640 1 -- 172.21.15.136:0/529376079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba1d71b3d0 con 0x55ba1d6cd840 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d3e000640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d2805c4c0 tx=0x7f4d28001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4d6405668e7e52 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2805fca0 con 0x55ba1d6cd840 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mon.0 v2:172.21.15.136:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4d2805b840 con 0x55ba1d6cd840 2024-05-04T07:51:50.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d30054740 con 0x55ba1d6cd840 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d28070050 con 0x55ba1d6cd840 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d48d76740 10 client.5046 fetch_fsmap learned FSMap version 19 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ba1d7367d0 con 0x55ba1d6cd840 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mon.0 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d30054740 con 0x55ba1d6cd840 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mon.0 v2:172.21.15.136:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4d28073020 con 0x55ba1d6cd840 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.764+0000 7f4d48d76740 10 client.5046 fetch_fsmap finished waiting for FSMap version 19 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d48d76740 10 client.5046 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d48d76740 20 client.5046 populate_metadata read hostname 'smithi136' 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d6eff20 0x55ba1d791370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d48d76740 4 client.5046 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 --> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] -- command(tid 0: {"prefix": "status"}) -- 0x55ba1d639210 con 0x55ba1d6eff20 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d6eff20 0x55ba1d791370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d3ea00640 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d6eff20 0x55ba1d791370 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceaa2a6cd0e96efc server_cookie=6bfa7bebe3d34d39 in_seq=0 out_seq=0 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d27e00640 10 client.5046 ms_handle_connect on v2:172.21.15.136:6836/2426434001 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d27e00640 1 -- 172.21.15.136:0/529376079 <== mds.0 v2:172.21.15.136:6836/2426434001 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ba1d639210 con 0x55ba1d6eff20 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.765+0000 7f4d27e00640 10 client.5046 handle_command_reply: tid=0 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 client.5046 shutdown 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 msgr2=0x55ba1d78b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d2805c4c0 tx=0x7f4d28001250 comp rx=0 tx=0).stop 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 shutdown_connections 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:6836/2426434001,v1:172.21.15.136:6837/2426434001] conn(0x55ba1d6eff20 0x55ba1d791370 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ba1d715f90 0x55ba1d6f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ba1d6cd840 0x55ba1d78b490 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 --2- 172.21.15.136:0/529376079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ba1d6cc980 0x55ba1d7374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d27e00640 0 client.5046 ms_handle_reset on v2:172.21.15.136:6836/2426434001 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 >> 172.21.15.136:0/529376079 conn(0x55ba1d6c86d0 msgr2=0x55ba1d6ea630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 shutdown_connections 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 1 -- 172.21.15.136:0/529376079 wait complete. 2024-05-04T07:51:50.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.766+0000 7f4d48d76740 20 client.5046 trim_cache size 0 max 16384 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "cluster_fsid": "9ecc10c5-f8dd-4dd0-88f7-548a507c724d", 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "whoami": 0, 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "id": 4884, 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "want_state": "up:active", 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "state": "up:active", 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "fs_name": "cephfs", 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "rank_uptime": 6.6633060439999996, 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "mdsmap_epoch": 19, 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch": 39, 2024-05-04T07:51:50.772 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_epoch_barrier": 39, 2024-05-04T07:51:50.773 INFO:teuthology.orchestra.run.smithi136.stdout: "uptime": 15.595032615999999 2024-05-04T07:51:50.773 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:51:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 msgr2=0x7f4d1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 0x7f4d1c078790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d30034000 tx=0x7f4d3002e000 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 msgr2=0x7f4d400b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c770 tx=0x7f4d2800cc30 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 shutdown_connections 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4d1c0762d0 0x7f4d1c078790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400ce820 0x7f4d400b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4d400cb7b0 0x7f4d400b5130 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 --2- 172.21.15.136:0/569785746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d40071ed0 0x7f4d40162a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 >> 172.21.15.136:0/569785746 conn(0x7f4d400d0c50 msgr2=0x7f4d400d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 shutdown_connections 2024-05-04T07:51:50.774 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.767+0000 7f4d45e00640 1 -- 172.21.15.136:0/569785746 wait complete. 2024-05-04T07:51:50.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T07:51:50.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.983+0000 7f7dc4a00640 1 Processor -- start 2024-05-04T07:51:50.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.983+0000 7f7dc4a00640 1 -- start start 2024-05-04T07:51:50.986 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7dc4a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7dc4a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc00b1c60 0x7f7dc00d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7dc4a00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dc00d3d80 con 0x7f7dc00b49e0 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7dc4a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7dc00b2170 con 0x7f7dc00b1c60 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7dc4a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc00b2430 con 0x7f7dc00d3460 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7db7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc00b1c60 0x7f7dc00d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7db7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7dc00b1c60 0x7f7dc00d59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54134/0 (socket says 172.21.15.136:54134) 2024-05-04T07:51:50.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.985+0000 7f7db7e00640 1 -- 172.21.15.136:0/143815578 learned_addr learned my addr 172.21.15.136:0/143815578 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.986+0000 7f7dbf400640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.986+0000 7f7db7e00640 1 -- 172.21.15.136:0/143815578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 msgr2=0x7f7dc00d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.986+0000 7f7db7e00640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00d3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.986+0000 7f7db7e00640 1 -- 172.21.15.136:0/143815578 >> v1:172.21.15.142:6789/0 conn(0x7f7dc00b49e0 legacy=0x7f7dc00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:51:50.988 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.986+0000 7f7db7e00640 1 -- 172.21.15.136:0/143815578 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00b2710 con 0x7f7dc00b1c60 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.987+0000 7f7db7e00640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b1c60 0x7f7dc00d59c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009870 tx=0x7f7da802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dac77ceb52aa376 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.987+0000 7f7dbea00640 1 -- 172.21.15.136:0/143815578 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8037070 con 0x7f7dc00b1c60 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.987+0000 7f7dbea00640 1 -- 172.21.15.136:0/143815578 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8032440 con 0x7f7dc00b1c60 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.987+0000 7f7dbea00640 1 -- 172.21.15.136:0/143815578 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8032810 con 0x7f7dc00b1c60 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 -- 172.21.15.136:0/143815578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b1c60 msgr2=0x7f7dc00d59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.989 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b1c60 0x7f7dc00d59c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009870 tx=0x7f7da802a130 comp rx=0 tx=0).stop 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 -- 172.21.15.136:0/143815578 shutdown_connections 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b1c60 0x7f7dc00d59c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/143815578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 -- 172.21.15.136:0/143815578 >> 172.21.15.136:0/143815578 conn(0x7f7dc009e370 msgr2=0x7f7dc00d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 -- 172.21.15.136:0/143815578 shutdown_connections 2024-05-04T07:51:50.990 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.988+0000 7f7dc4a00640 1 -- 172.21.15.136:0/143815578 wait complete. 2024-05-04T07:51:50.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.990+0000 7f7dc4a00640 1 Processor -- start 2024-05-04T07:51:50.991 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.990+0000 7f7dc4a00640 1 -- start start 2024-05-04T07:51:50.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 0x7f7dc015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc00d5f00 con 0x7f7dc00b49e0 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc00b2cd0 con 0x7f7dc00b1c60 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dc4a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc00b4200 con 0x7f7dc00d3460 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:54148/0 (socket says 172.21.15.136:54148) 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 -- 172.21.15.136:0/849865822 learned_addr learned my addr 172.21.15.136:0/849865822 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dbf400640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 0x7f7dc015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dbfe00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 -- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 msgr2=0x7f7dc00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 -- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 msgr2=0x7f7dc015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:50.994 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 0x7f7dc015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:50.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7db7e00640 1 -- 172.21.15.136:0/849865822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc00ca0b0 con 0x7f7dc00b49e0 2024-05-04T07:51:50.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dbfe00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:50.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.991+0000 7f7dbf400640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 0x7f7dc015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:51:50.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7db7e00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009870 tx=0x7f7da80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8041070 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da803c870 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8037040 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc00ca390 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.992+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc00ca950 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.994+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc00d4980 con 0x7f7dc00b49e0 2024-05-04T07:51:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.995+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7da8044070 con 0x7f7dc00b49e0 2024-05-04T07:51:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.996+0000 7f7db7400640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 0x7f7d9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:51:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.996+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7da80b8370 con 0x7f7dc00b49e0 2024-05-04T07:51:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.997+0000 7f7dbf400640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 0x7f7d9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:51:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:50.997+0000 7f7dbf400640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 0x7f7d9c078790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b820 tx=0x7f7db0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:51:51.003 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.001+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7dc00d4980 con 0x7f7dc00b49e0 2024-05-04T07:51:51.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.252+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7dc0069400 con 0x7f7dc00b49e0 2024-05-04T07:51:51.254 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.253+0000 7f7db7400640 1 -- 172.21.15.136:0/849865822 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f7da8081b40 con 0x7f7dc00b49e0 2024-05-04T07:51:51.254 INFO:teuthology.orchestra.run.smithi136.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-04T07:51:51.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.255+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 msgr2=0x7f7d9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:51.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.255+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 0x7f7d9c078790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b820 tx=0x7f7db0008040 comp rx=0 tx=0).stop 2024-05-04T07:51:51.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.255+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 msgr2=0x7f7dc00cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:51:51.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.255+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009870 tx=0x7f7da80046c0 comp rx=0 tx=0).stop 2024-05-04T07:51:51.257 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.255+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 shutdown_connections 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d9c0762d0 0x7f7d9c078790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc00d3460 0x7f7dc00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7dc00b49e0 0x7f7dc00cc170 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 --2- 172.21.15.136:0/849865822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc00b1c60 0x7f7dc015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 >> 172.21.15.136:0/849865822 conn(0x7f7dc009e370 msgr2=0x7f7dc00b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 shutdown_connections 2024-05-04T07:51:51.258 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51.256+0000 7f7dc4a00640 1 -- 172.21.15.136:0/849865822 wait complete. 2024-05-04T07:51:51.275 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-04T07:51:51.275 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T07:51:51.275 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-05-04T07:51:51.275 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-04T07:51:51.276 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:51.276 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-04T07:51:51.276 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-04T07:51:51.276 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T07:51:51.276 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-04T07:51:51.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.276 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-05-04T07:51:51.329 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T07:51:51.329 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T07:51:51.329 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T07:51:51.329 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.329 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42541sec preferred_lft 42541sec 2024-05-04T07:51:51.330 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 1e:5c:44:fc:06:3f brd ff:ff:ff:ff:ff:ff 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::48ba:3fff:fe54:7fbb/64 scope link 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether ea:11:4a:5a:6e:9d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::e811:4aff:fe5a:6e9d/64 scope link 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-04T07:51:51.331 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 1e:5c:44:fc:06:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-04T07:51:51.332 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::1c5c:44ff:fefc:63f/64 scope link 2024-05-04T07:51:51.332 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-05-04T07:51:51.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.332 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T07:51:51.403 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-05-04T07:51:51.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.407 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-05-04T07:51:51.459 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-05-04T07:51:51.459 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T07:51:51.459 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-04T07:51:51.459 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-04T07:51:51.459 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-04T07:51:51.460 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-05-04T07:51:51.562 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T07:51:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.662 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:51:51.710 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-04T07:51:51.710 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-04T07:51:51.711 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-04T07:51:51.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.712 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-05-04T07:51:51.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:51.793 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:51.848 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-04T07:51:51.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T07:51:51.848 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:51.897 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-04T07:51:51.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:51.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:52.018 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:52.018 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:52.052 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-04T07:51:52.052 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-04T07:51:52.053 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.136:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-05-04T07:51:52.053 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 0@9ecc10c5-f8dd-4dd0-88f7-548a507c724d.cephfs=/ 2024-05-04T07:51:52.053 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.136:3300/172.21.15.142:3300/172.21.15.142:3301" will pass to kernel 2024-05-04T07:51:52.055 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-04T07:51:52.055 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-05-04T07:51:52.055 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-04T07:51:52.055 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-05-04T07:51:52.055 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-04T07:51:52.059 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-04T07:51:52.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:52.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-04T07:51:52.132 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-04T07:51:52.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-04T07:51:52.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:51:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T07:51:52.258 INFO:teuthology.orchestra.run.smithi136.stdout:client5055 2024-05-04T07:51:52.259 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:51:52.259 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:51:52.307 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=xfstests-dev 2024-05-04T07:51:52.403 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.V8XnAFKYKlxfstests-dev 2024-05-04T07:51:52.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:52.403 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.V8XnAFKYKlxfstests-dev) 2024-05-04T07:51:52.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:52.486 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.V8XnAFKYKlxfstests-dev) 2024-05-04T07:51:52.539 INFO:teuthology.orchestra.run.smithi136.stderr:Cloning into '/tmp/tmp.V8XnAFKYKlxfstests-dev'... 2024-05-04T07:51:53.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:53.600 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-04T07:51:53.665 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=test 2024-05-04T07:51:53.715 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.JxbPMaIwRJtest 2024-05-04T07:51:53.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:51:53.715 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-04T07:51:53.765 DEBUG:teuthology.orchestra.run.smithi136:> mktemp -d --suffix=scratch 2024-05-04T07:51:53.813 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.IpKHCzrTQkscratch 2024-05-04T07:51:53.813 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-05-04T07:51:53.814 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-05-04T07:51:54.591 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:04:47 ago on Sat 04 May 2024 07:47:07 AM UTC. 2024-05-04T07:51:54.679 INFO:teuthology.orchestra.run.smithi136.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T07:51:54.679 INFO:teuthology.orchestra.run.smithi136.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-05-04T07:51:54.680 INFO:teuthology.orchestra.run.smithi136.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-05-04T07:51:54.681 INFO:teuthology.orchestra.run.smithi136.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-05-04T07:51:54.682 INFO:teuthology.orchestra.run.smithi136.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-05-04T07:51:54.683 INFO:teuthology.orchestra.run.smithi136.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-05-04T07:51:54.685 INFO:teuthology.orchestra.run.smithi136.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-05-04T07:51:54.686 INFO:teuthology.orchestra.run.smithi136.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-05-04T07:51:54.688 INFO:teuthology.orchestra.run.smithi136.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-05-04T07:51:54.690 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T07:51:54.691 INFO:teuthology.orchestra.run.smithi136.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-05-04T07:51:54.692 INFO:teuthology.orchestra.run.smithi136.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-05-04T07:51:54.693 INFO:teuthology.orchestra.run.smithi136.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-05-04T07:51:54.694 INFO:teuthology.orchestra.run.smithi136.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-05-04T07:51:54.695 INFO:teuthology.orchestra.run.smithi136.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-05-04T07:51:54.696 INFO:teuthology.orchestra.run.smithi136.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-05-04T07:51:54.697 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-05-04T07:51:54.697 INFO:teuthology.orchestra.run.smithi136.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-05-04T07:51:54.698 INFO:teuthology.orchestra.run.smithi136.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-05-04T07:51:54.701 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-04T07:51:54.747 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-05-04T07:51:54.749 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-04T07:51:54.749 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-05-04T07:51:54.749 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-04T07:51:54.749 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-05-04T07:51:54.749 INFO:teuthology.orchestra.run.smithi136.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-devel x86_64 5.14.0-437.el9 appstream 16 M 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-05-04T07:51:54.750 INFO:teuthology.orchestra.run.smithi136.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout:Install 17 Packages 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 1 Package 2024-05-04T07:51:54.751 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:51:54.752 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 24 M 2024-05-04T07:51:54.752 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-05-04T07:51:55.809 INFO:teuthology.orchestra.run.smithi136.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 145 kB/s | 18 kB 00:00 2024-05-04T07:51:55.859 INFO:teuthology.orchestra.run.smithi136.stdout:(2/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 319 kB/s | 16 kB 00:00 2024-05-04T07:51:55.893 INFO:teuthology.orchestra.run.smithi136.stdout:(3/18): rmt-1.6-6.el9.x86_64.rpm 221 kB/s | 46 kB 00:00 2024-05-04T07:51:55.909 INFO:teuthology.orchestra.run.smithi136.stdout:(4/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 294 kB/s | 15 kB 00:00 2024-05-04T07:51:55.943 INFO:teuthology.orchestra.run.smithi136.stdout:(5/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 318 kB/s | 16 kB 00:00 2024-05-04T07:51:56.002 INFO:teuthology.orchestra.run.smithi136.stdout:(6/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 359 kB/s | 21 kB 00:00 2024-05-04T07:51:56.036 INFO:teuthology.orchestra.run.smithi136.stdout:(7/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 129 kB/s | 16 kB 00:00 2024-05-04T07:51:56.128 INFO:teuthology.orchestra.run.smithi136.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 448 kB/s | 41 kB 00:00 2024-05-04T07:51:56.303 INFO:teuthology.orchestra.run.smithi136.stdout:(9/18): libnbd-1.18.1-3.el9.x86_64.rpm 956 kB/s | 166 kB 00:00 2024-05-04T07:51:56.429 INFO:teuthology.orchestra.run.smithi136.stdout:(10/18): fio-3.35-1.el9.x86_64.rpm 8.4 MB/s | 6.2 MB 00:00 2024-05-04T07:51:56.504 INFO:teuthology.orchestra.run.smithi136.stdout:(11/18): udftools-2.2-5.el9.x86_64.rpm 2.0 MB/s | 149 kB 00:00 2024-05-04T07:51:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:(12/18): sqlite-3.34.1-7.el9.x86_64.rpm 1.8 MB/s | 748 kB 00:00 2024-05-04T07:51:56.746 INFO:teuthology.orchestra.run.smithi136.stdout:(13/18): gdbm-1.23-1.el9.x86_64.rpm 638 kB/s | 153 kB 00:00 2024-05-04T07:51:56.871 INFO:teuthology.orchestra.run.smithi136.stdout:(14/18): gdbm-devel-1.23-1.el9.x86_64.rpm 540 kB/s | 81 kB 00:00 2024-05-04T07:51:57.163 INFO:teuthology.orchestra.run.smithi136.stdout:(15/18): kernel-devel-5.14.0-437.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-05-04T07:51:57.188 INFO:teuthology.orchestra.run.smithi136.stdout:(16/18): dump-0.4-0.51.b47.el9.x86_64.rpm 199 kB/s | 88 kB 00:00 2024-05-04T07:51:57.330 INFO:teuthology.orchestra.run.smithi136.stdout:(17/18): gdbm-libs-1.23-1.el9.x86_64.rpm 340 kB/s | 56 kB 00:00 2024-05-04T07:51:57.589 INFO:teuthology.orchestra.run.smithi136.stdout:(18/18): indent-2.2.13-5.el9.x86_64.rpm 251 kB/s | 179 kB 00:00 2024-05-04T07:51:57.590 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-05-04T07:51:57.590 INFO:teuthology.orchestra.run.smithi136.stdout:Total 8.4 MB/s | 24 MB 00:02 2024-05-04T07:51:58.344 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-05-04T07:51:58.465 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-05-04T07:51:58.466 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-05-04T07:51:59.275 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-05-04T07:51:59.303 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-05-04T07:52:00.502 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-05-04T07:52:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-05-04T07:52:00.673 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-05-04T07:52:00.704 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 3/19 2024-05-04T07:52:00.746 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-05-04T07:52:00.922 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-05-04T07:52:00.965 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-05-04T07:52:00.999 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-05-04T07:52:01.034 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-05-04T07:52:01.297 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-05-04T07:52:01.345 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-05-04T07:52:01.392 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-05-04T07:52:01.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-05-04T07:52:01.514 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-05-04T07:52:01.581 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-05-04T07:52:01.632 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-05-04T07:52:01.710 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-05-04T07:52:13.189 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-05-04T07:52:13.507 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-devel-5.14.0-437.el9.x86_64 18/19 2024-05-04T07:52:14.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:52:14.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:52:44.531 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:52:44.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:53:04.247 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-devel-5.14.0-437.el9.x86_64 18/19 2024-05-04T07:53:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-04T07:53:05.102 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-05-04T07:53:05.103 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-devel-5.14.0-437.el9.x86_64 9/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-05-04T07:53:05.104 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-05-04T07:53:05.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-437.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: udftools-2.2-5.el9.x86_64 2024-05-04T07:53:05.665 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:53:05.666 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-05-04T07:53:06.152 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd -m fsgqa 2024-05-04T07:53:06.216 INFO:teuthology.orchestra.run.smithi136.stderr:useradd: user 'fsgqa' already exists 2024-05-04T07:53:06.219 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-04T07:53:06.220 DEBUG:teuthology.orchestra.run.smithi136:> sudo groupadd fsgqa 2024-05-04T07:53:06.281 INFO:teuthology.orchestra.run.smithi136.stderr:groupadd: group 'fsgqa' already exists 2024-05-04T07:53:06.285 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-04T07:53:06.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd fsgqa2 2024-05-04T07:53:06.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo useradd 123456-fsgqa 2024-05-04T07:53:07.569 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-04T07:53:07.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.743+0000 7f58bf600640 1 Processor -- start 2024-05-04T07:53:07.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.743+0000 7f58bf600640 1 -- start start 2024-05-04T07:53:07.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.744+0000 7f58bf600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b813ff40 0x7f58b8145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.744+0000 7f58bf600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58b81463a0 0x7f58b8071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.744+0000 7f58bf600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b8146900 con 0x7f58b8072430 2024-05-04T07:53:07.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.744+0000 7f58bf600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f58b8140320 con 0x7f58b81463a0 2024-05-04T07:53:07.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.744+0000 7f58bf600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f58b815de40 con 0x7f58b813ff40 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58b81463a0 0x7f58b8071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58bd600640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f58b8072430 0x7f58b8142640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:43118/0 (socket says 172.21.15.136:43118) 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58bd600640 1 -- 172.21.15.136:0/4100803453 learned_addr learned my addr 172.21.15.136:0/4100803453 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58bcc00640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b813ff40 0x7f58b8145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7400640 1 -- 172.21.15.136:0/4100803453 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739170830 0 0) 0x7f58b8146900 con 0x7f58b8072430 2024-05-04T07:53:07.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7e00640 1 -- 172.21.15.136:0/4100803453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b813ff40 msgr2=0x7f58b8145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:53:07.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7e00640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b813ff40 0x7f58b8145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:07.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7e00640 1 -- 172.21.15.136:0/4100803453 >> v1:172.21.15.136:6789/0 conn(0x7f58b8072430 legacy=0x7f58b8142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:07.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.745+0000 7f58b7e00640 1 -- 172.21.15.136:0/4100803453 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b815d7f0 con 0x7f58b81463a0 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58b7e00640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b8071ef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefb895a8c026876 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58b7400640 1 -- 172.21.15.136:0/4100803453 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8037070 con 0x7f58b81463a0 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58b7400640 1 -- 172.21.15.136:0/4100803453 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8032440 con 0x7f58b81463a0 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58b7400640 1 -- 172.21.15.136:0/4100803453 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8032810 con 0x7f58b81463a0 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 -- 172.21.15.136:0/4100803453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 msgr2=0x7f58b8071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b8071ef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f58a80097a0 tx=0x7f58a802a180 comp rx=0 tx=0).stop 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 -- 172.21.15.136:0/4100803453 shutdown_connections 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b8071ef0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 --2- 172.21.15.136:0/4100803453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b813ff40 0x7f58b8145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:07.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.747+0000 7f58bf600640 1 -- 172.21.15.136:0/4100803453 >> 172.21.15.136:0/4100803453 conn(0x7f58b80d0c30 msgr2=0x7f58b80d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:53:07.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.748+0000 7f58bf600640 1 -- 172.21.15.136:0/4100803453 shutdown_connections 2024-05-04T07:53:07.749 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.748+0000 7f58bf600640 1 -- 172.21.15.136:0/4100803453 wait complete. 2024-05-04T07:53:07.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.749+0000 7f58bf600640 1 Processor -- start 2024-05-04T07:53:07.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.749+0000 7f58bf600640 1 -- start start 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8072430 0x7f58b813b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b813ff40 0x7f58b815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f58b8161910 con 0x7f58b81463a0 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58b80c6ac0 con 0x7f58b813ff40 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.750+0000 7f58bf600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f58b815d4a0 con 0x7f58b8072430 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.751 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46980/0 (socket says 172.21.15.136:46980) 2024-05-04T07:53:07.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 -- 172.21.15.136:0/2071580226 learned_addr learned my addr 172.21.15.136:0/2071580226 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bcc00640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8072430 0x7f58b813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58b7e00640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b813ff40 0x7f58b815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 -- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8072430 msgr2=0x7f58b813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8072430 0x7f58b813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 -- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b813ff40 msgr2=0x7f58b815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b813ff40 0x7f58b815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.751+0000 7f58bd600640 1 -- 172.21.15.136:0/2071580226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b80b3d10 con 0x7f58b81463a0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58bd600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7a0 tx=0x7f58b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0018070 con 0x7f58b81463a0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b000a5e0 con 0x7f58b81463a0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b000aa50 con 0x7f58b81463a0 2024-05-04T07:53:07.753 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b80b3ff0 con 0x7f58b81463a0 2024-05-04T07:53:07.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.752+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b80b45b0 con 0x7f58b81463a0 2024-05-04T07:53:07.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.754+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b8069400 con 0x7f58b81463a0 2024-05-04T07:53:07.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.754+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58b001b070 con 0x7f58b81463a0 2024-05-04T07:53:07.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.756+0000 7f58b4c00640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 0x7f589c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:07.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.756+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f58b0096dd0 con 0x7f58b81463a0 2024-05-04T07:53:07.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.756+0000 7f58bcc00640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 0x7f589c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:07.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.757+0000 7f58bcc00640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 0x7f589c078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f58ac006fd0 tx=0x7f58ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:07.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:07.761+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58b0060570 con 0x7f58b81463a0 2024-05-04T07:53:08.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.064+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f58b80c7970 con 0x7f58b81463a0 2024-05-04T07:53:08.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.065+0000 7f58b4c00640 1 -- 172.21.15.136:0/2071580226 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f58b005fe70 con 0x7f58b81463a0 2024-05-04T07:53:08.066 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:53:08.066 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","modified":"2024-05-04T07:49:16.070038Z","created":"2024-05-04T07:49:16.070038Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3301","nonce":0},{"type":"v1","addr":"172.21.15.142:6790","nonce":0}]},"addr":"172.21.15.142:6790/0","public_addr":"172.21.15.142:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-04T07:53:08.066 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-05-04T07:53:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.067+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 msgr2=0x7f589c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.067+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 0x7f589c078790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f58ac006fd0 tx=0x7f58ac008040 comp rx=0 tx=0).stop 2024-05-04T07:53:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.067+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 msgr2=0x7f58b80cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.067+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f58b000c7a0 tx=0x7f58b000cc60 comp rx=0 tx=0).stop 2024-05-04T07:53:08.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 shutdown_connections 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f589c0762d0 0x7f589c078790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58b81463a0 0x7f58b80cf850 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58b813ff40 0x7f58b815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 --2- 172.21.15.136:0/2071580226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58b8072430 0x7f58b813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 >> 172.21.15.136:0/2071580226 conn(0x7f58b80d0c30 msgr2=0x7f58b815e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 shutdown_connections 2024-05-04T07:53:08.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.068+0000 7f58bf600640 1 -- 172.21.15.136:0/2071580226 wait complete. 2024-05-04T07:53:08.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-05-04T07:53:08.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.260+0000 7f0aff200640 1 Processor -- start 2024-05-04T07:53:08.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.260+0000 7f0aff200640 1 -- start start 2024-05-04T07:53:08.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0aff200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b0015f0e0 0x7f0b000d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0aff200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000cfa70 0x7f0b000cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0aff200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000d5e00 con 0x7f0b000d03f0 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0aff200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000b8850 con 0x7f0b0015f0e0 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0aff200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d0a10 con 0x7f0b000cfa70 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0afde00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b0015f0e0 0x7f0b000d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0afe800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f0b000d03f0 0x7f0b000d2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:43122/0 (socket says 172.21.15.136:43122) 2024-05-04T07:53:08.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.261+0000 7f0afe800640 1 -- 172.21.15.136:0/2332681549 learned_addr learned my addr 172.21.15.136:0/2332681549 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:53:08.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.262+0000 7f0af5400640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000cfa70 0x7f0b000cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.262+0000 7f0afde00640 1 -- 172.21.15.136:0/2332681549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000cfa70 msgr2=0x7f0b000cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:53:08.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.262+0000 7f0afde00640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000cfa70 0x7f0b000cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.262+0000 7f0afde00640 1 -- 172.21.15.136:0/2332681549 >> v1:172.21.15.136:6789/0 conn(0x7f0b000d03f0 legacy=0x7f0b000d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.262+0000 7f0afde00640 1 -- 172.21.15.136:0/2332681549 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000d0cf0 con 0x7f0b0015f0e0 2024-05-04T07:53:08.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.263+0000 7f0afde00640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0015f0e0 0x7f0b000d58c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef6cba55d905598 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:08.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.263+0000 7f0afd400640 1 -- 172.21.15.136:0/2332681549 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8037070 con 0x7f0b0015f0e0 2024-05-04T07:53:08.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.263+0000 7f0afd400640 1 -- 172.21.15.136:0/2332681549 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8032440 con 0x7f0b0015f0e0 2024-05-04T07:53:08.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.263+0000 7f0afd400640 1 -- 172.21.15.136:0/2332681549 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8032810 con 0x7f0b0015f0e0 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 -- 172.21.15.136:0/2332681549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0015f0e0 msgr2=0x7f0b000d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0015f0e0 0x7f0b000d58c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80097a0 tx=0x7f0ae802a210 comp rx=0 tx=0).stop 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 -- 172.21.15.136:0/2332681549 shutdown_connections 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000cfa70 0x7f0b000cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 --2- 172.21.15.136:0/2332681549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0015f0e0 0x7f0b000d58c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 -- 172.21.15.136:0/2332681549 >> 172.21.15.136:0/2332681549 conn(0x7f0b0009e380 msgr2=0x7f0b000d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 -- 172.21.15.136:0/2332681549 shutdown_connections 2024-05-04T07:53:08.265 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.264+0000 7f0aff200640 1 -- 172.21.15.136:0/2332681549 wait complete. 2024-05-04T07:53:08.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.266+0000 7f0aff200640 1 Processor -- start 2024-05-04T07:53:08.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.266+0000 7f0aff200640 1 -- start start 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 0x7f0b00161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 0x7f0b00150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015f4c0 con 0x7f0b000cfa70 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000b8d80 con 0x7f0b0015f0e0 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0aff200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d3d40 con 0x7f0b000d03f0 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0afde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0afde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47000/0 (socket says 172.21.15.136:47000) 2024-05-04T07:53:08.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0afde00640 1 -- 172.21.15.136:0/915829253 learned_addr learned my addr 172.21.15.136:0/915829253 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.267+0000 7f0af5400640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 0x7f0b00161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 -- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 msgr2=0x7f0b00161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 0x7f0b00161d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 -- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 msgr2=0x7f0b00150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afe800640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 0x7f0b00150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 0x7f0b00150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 -- 172.21.15.136:0/915829253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00162270 con 0x7f0b000cfa70 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0af5400640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 0x7f0b00161d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afe800640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 0x7f0b00150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0afde00640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8035040 tx=0x7f0ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.268+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8037040 con 0x7f0b000cfa70 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.269+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae8030770 con 0x7f0b000cfa70 2024-05-04T07:53:08.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.269+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b000a2590 con 0x7f0b000cfa70 2024-05-04T07:53:08.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.269+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8030b80 con 0x7f0b000cfa70 2024-05-04T07:53:08.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.269+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b000a2b50 con 0x7f0b000cfa70 2024-05-04T07:53:08.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.270+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b00069400 con 0x7f0b000cfa70 2024-05-04T07:53:08.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.272+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ae8044020 con 0x7f0b000cfa70 2024-05-04T07:53:08.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.273+0000 7f0af6a00640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 0x7f0adc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:53:08.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.274+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f0ae80b7da0 con 0x7f0b000cfa70 2024-05-04T07:53:08.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.274+0000 7f0af5400640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 0x7f0adc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:53:08.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.274+0000 7f0af5400640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 0x7f0adc078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cb590 tx=0x7f0af0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:53:08.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.279+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ae8032e20 con 0x7f0b000cfa70 2024-05-04T07:53:08.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.563+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f0b000d3b20 con 0x7f0b000cfa70 2024-05-04T07:53:08.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.563+0000 7f0af6a00640 1 -- 172.21.15.136:0/915829253 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) ==== 92+0+63 (secure 0 0 0) 0x7f0ae8081550 con 0x7f0b000cfa70 2024-05-04T07:53:08.564 INFO:teuthology.orchestra.run.smithi136.stdout:[client.admin] 2024-05-04T07:53:08.564 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQB86DVmWHp8GBAAjjXrjse7hK3mShim0Guy/g== 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 msgr2=0x7f0adc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 0x7f0adc078790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b000cb590 tx=0x7f0af0008040 comp rx=0 tx=0).stop 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 msgr2=0x7f0b0009f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8035040 tx=0x7f0ae80046c0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 shutdown_connections 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f0adc0762d0 0x7f0adc078790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b0015f0e0 0x7f0b00150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b000d03f0 0x7f0b00161d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.567 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 --2- 172.21.15.136:0/915829253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b000cfa70 0x7f0b0009f020 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:53:08.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 >> 172.21.15.136:0/915829253 conn(0x7f0b0009e380 msgr2=0x7f0b0006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:53:08.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 shutdown_connections 2024-05-04T07:53:08.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:53:08.566+0000 7f0aff200640 1 -- 172.21.15.136:0/915829253 wait complete. 2024-05-04T07:53:08.585 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:53:08.585 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/tmp/tmp.V8XnAFKYKlxfstests-dev/local.config 2024-05-04T07:53:08.649 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.136:6789:/test export TEST_DIR=/tmp/tmp.JxbPMaIwRJtest export SCRATCH_DEV=172.21.15.136:6789:/scratch export SCRATCH_MNT=/tmp/tmp.IpKHCzrTQkscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQB86DVmWHp8GBAAjjXrjse7hK3mShim0Guy/g==" 2024-05-04T07:53:08.649 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:53:08.649 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/tmp/tmp.V8XnAFKYKlxfstests-dev/ceph.exclude 2024-05-04T07:53:08.756 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.V8XnAFKYKlxfstests-dev && exec sudo make) 2024-05-04T07:53:08.892 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize -cfi 2024-05-04T07:53:09.401 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-04T07:53:09.401 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './config.guess' 2024-05-04T07:53:09.411 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './config.sub' 2024-05-04T07:53:09.423 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './install-sh' 2024-05-04T07:53:09.435 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file './ltmain.sh' 2024-05-04T07:53:09.506 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-04T07:53:09.507 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-04T07:53:09.525 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-04T07:53:09.541 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-04T07:53:09.558 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-04T07:53:09.578 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-04T07:53:09.600 INFO:teuthology.orchestra.run.smithi136.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-04T07:53:09.605 INFO:teuthology.orchestra.run.smithi136.stdout:cp include/install-sh . 2024-05-04T07:53:09.608 INFO:teuthology.orchestra.run.smithi136.stdout:aclocal -I m4 2024-05-04T07:53:11.257 INFO:teuthology.orchestra.run.smithi136.stdout:autoheader 2024-05-04T07:53:11.680 INFO:teuthology.orchestra.run.smithi136.stdout:autoconf 2024-05-04T07:53:11.950 INFO:teuthology.orchestra.run.smithi136.stdout:./configure \ 2024-05-04T07:53:11.950 INFO:teuthology.orchestra.run.smithi136.stdout: --libexecdir=/usr/lib \ 2024-05-04T07:53:11.950 INFO:teuthology.orchestra.run.smithi136.stdout: --exec_prefix=/var/lib 2024-05-04T07:53:12.660 INFO:teuthology.orchestra.run.smithi136.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-04T07:53:12.660 INFO:teuthology.orchestra.run.smithi136.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-04T07:53:12.665 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to print strings... printf 2024-05-04T07:53:12.666 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc... gcc 2024-05-04T07:53:12.879 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether the C compiler works... yes 2024-05-04T07:53:12.879 INFO:teuthology.orchestra.run.smithi136.stdout:checking for C compiler default output file name... a.out 2024-05-04T07:53:12.953 INFO:teuthology.orchestra.run.smithi136.stdout:checking for suffix of executables... 2024-05-04T07:53:13.064 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are cross compiling... no 2024-05-04T07:53:13.118 INFO:teuthology.orchestra.run.smithi136.stdout:checking for suffix of object files... o 2024-05-04T07:53:13.166 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are using the GNU C compiler... yes 2024-05-04T07:53:13.213 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc accepts -g... yes 2024-05-04T07:53:13.342 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-04T07:53:13.351 INFO:teuthology.orchestra.run.smithi136.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-04T07:53:13.360 INFO:teuthology.orchestra.run.smithi136.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-04T07:53:13.364 INFO:teuthology.orchestra.run.smithi136.stdout:checking for egrep... /bin/grep -E 2024-05-04T07:53:13.368 INFO:teuthology.orchestra.run.smithi136.stdout:checking for fgrep... /bin/grep -F 2024-05-04T07:53:13.380 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ld used by gcc... /bin/ld 2024-05-04T07:53:13.386 INFO:teuthology.orchestra.run.smithi136.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-04T07:53:13.399 INFO:teuthology.orchestra.run.smithi136.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-04T07:53:14.459 INFO:teuthology.orchestra.run.smithi136.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-04T07:53:14.459 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether ln -s works... yes 2024-05-04T07:53:14.477 INFO:teuthology.orchestra.run.smithi136.stdout:checking the maximum length of command line arguments... 1572864 2024-05-04T07:53:14.487 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-04T07:53:14.487 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-04T07:53:14.488 INFO:teuthology.orchestra.run.smithi136.stdout:checking for /bin/ld option to reload object files... -r 2024-05-04T07:53:14.488 INFO:teuthology.orchestra.run.smithi136.stdout:checking for objdump... objdump 2024-05-04T07:53:14.489 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to recognize dependent libraries... pass_all 2024-05-04T07:53:14.490 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dlltool... no 2024-05-04T07:53:14.490 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-04T07:53:14.491 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ar... ar 2024-05-04T07:53:14.602 INFO:teuthology.orchestra.run.smithi136.stdout:checking for archiver @FILE support... @ 2024-05-04T07:53:14.602 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strip... strip 2024-05-04T07:53:14.604 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ranlib... ranlib 2024-05-04T07:53:14.604 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gawk... gawk 2024-05-04T07:53:14.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:53:14.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:53:14.763 INFO:teuthology.orchestra.run.smithi136.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-04T07:53:14.767 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sysroot... no 2024-05-04T07:53:14.776 INFO:teuthology.orchestra.run.smithi136.stdout:checking for a working dd... /bin/dd 2024-05-04T07:53:14.785 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-04T07:53:14.821 INFO:teuthology.orchestra.run.smithi136.stdout:checking for mt... no 2024-05-04T07:53:14.829 INFO:teuthology.orchestra.run.smithi136.stdout:checking if : is a manifest tool... no 2024-05-04T07:53:14.934 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to run the C preprocessor... gcc -E 2024-05-04T07:53:15.277 INFO:teuthology.orchestra.run.smithi136.stdout:checking for ANSI C header files... yes 2024-05-04T07:53:15.335 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/types.h... yes 2024-05-04T07:53:15.395 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/stat.h... yes 2024-05-04T07:53:15.457 INFO:teuthology.orchestra.run.smithi136.stdout:checking for stdlib.h... yes 2024-05-04T07:53:15.527 INFO:teuthology.orchestra.run.smithi136.stdout:checking for string.h... yes 2024-05-04T07:53:15.592 INFO:teuthology.orchestra.run.smithi136.stdout:checking for memory.h... yes 2024-05-04T07:53:15.650 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strings.h... yes 2024-05-04T07:53:15.714 INFO:teuthology.orchestra.run.smithi136.stdout:checking for inttypes.h... yes 2024-05-04T07:53:15.775 INFO:teuthology.orchestra.run.smithi136.stdout:checking for stdint.h... yes 2024-05-04T07:53:15.838 INFO:teuthology.orchestra.run.smithi136.stdout:checking for unistd.h... yes 2024-05-04T07:53:15.896 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dlfcn.h... yes 2024-05-04T07:53:15.905 INFO:teuthology.orchestra.run.smithi136.stdout:checking for objdir... .libs 2024-05-04T07:53:16.066 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-04T07:53:16.067 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-04T07:53:16.117 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-04T07:53:16.177 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc static flag -static works... no 2024-05-04T07:53:16.241 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -c -o file.o... yes 2024-05-04T07:53:16.241 INFO:teuthology.orchestra.run.smithi136.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-04T07:53:16.260 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-04T07:53:16.323 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether -lc should be explicitly linked in... no 2024-05-04T07:53:16.456 INFO:teuthology.orchestra.run.smithi136.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-04T07:53:16.457 INFO:teuthology.orchestra.run.smithi136.stdout:checking how to hardcode library paths into programs... immediate 2024-05-04T07:53:16.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether stripping libraries is possible... yes 2024-05-04T07:53:16.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking if libtool supports shared libraries... yes 2024-05-04T07:53:16.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether to build shared libraries... yes 2024-05-04T07:53:16.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether to build static libraries... yes 2024-05-04T07:53:16.476 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc... (cached) gcc 2024-05-04T07:53:16.520 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-04T07:53:16.520 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-04T07:53:16.521 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-04T07:53:16.521 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gmake... /usr/bin/gmake 2024-05-04T07:53:16.521 INFO:teuthology.orchestra.run.smithi136.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-04T07:53:16.522 INFO:teuthology.orchestra.run.smithi136.stdout:checking for tar... /bin/tar 2024-05-04T07:53:16.522 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gzip... /bin/gzip 2024-05-04T07:53:16.559 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether gcc -MM is supported... yes 2024-05-04T07:53:16.559 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sort... /bin/sort 2024-05-04T07:53:16.559 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether ln -s works... yes 2024-05-04T07:53:16.560 INFO:teuthology.orchestra.run.smithi136.stdout:checking for rpm... /bin/rpm 2024-05-04T07:53:16.570 INFO:teuthology.orchestra.run.smithi136.stdout:checking for rpmbuild... no 2024-05-04T07:53:16.628 INFO:teuthology.orchestra.run.smithi136.stdout:checking assert.h usability... yes 2024-05-04T07:53:16.651 INFO:teuthology.orchestra.run.smithi136.stdout:checking assert.h presence... yes 2024-05-04T07:53:16.651 INFO:teuthology.orchestra.run.smithi136.stdout:checking for assert.h... yes 2024-05-04T07:53:16.722 INFO:teuthology.orchestra.run.smithi136.stdout:checking bstring.h usability... no 2024-05-04T07:53:16.754 INFO:teuthology.orchestra.run.smithi136.stdout:checking bstring.h presence... no 2024-05-04T07:53:16.754 INFO:teuthology.orchestra.run.smithi136.stdout:checking for bstring.h... no 2024-05-04T07:53:16.812 INFO:teuthology.orchestra.run.smithi136.stdout:checking libgen.h usability... yes 2024-05-04T07:53:16.838 INFO:teuthology.orchestra.run.smithi136.stdout:checking libgen.h presence... yes 2024-05-04T07:53:16.838 INFO:teuthology.orchestra.run.smithi136.stdout:checking for libgen.h... yes 2024-05-04T07:53:16.913 INFO:teuthology.orchestra.run.smithi136.stdout:checking dirent.h usability... yes 2024-05-04T07:53:16.943 INFO:teuthology.orchestra.run.smithi136.stdout:checking dirent.h presence... yes 2024-05-04T07:53:16.943 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dirent.h... yes 2024-05-04T07:53:17.052 INFO:teuthology.orchestra.run.smithi136.stdout:checking errno.h usability... yes 2024-05-04T07:53:17.082 INFO:teuthology.orchestra.run.smithi136.stdout:checking errno.h presence... yes 2024-05-04T07:53:17.082 INFO:teuthology.orchestra.run.smithi136.stdout:checking for errno.h... yes 2024-05-04T07:53:17.160 INFO:teuthology.orchestra.run.smithi136.stdout:checking malloc.h usability... yes 2024-05-04T07:53:17.189 INFO:teuthology.orchestra.run.smithi136.stdout:checking malloc.h presence... yes 2024-05-04T07:53:17.189 INFO:teuthology.orchestra.run.smithi136.stdout:checking for malloc.h... yes 2024-05-04T07:53:17.268 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid.h usability... no 2024-05-04T07:53:17.310 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid.h presence... no 2024-05-04T07:53:17.310 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid.h... no 2024-05-04T07:53:17.383 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid/uuid.h usability... yes 2024-05-04T07:53:17.411 INFO:teuthology.orchestra.run.smithi136.stdout:checking uuid/uuid.h presence... yes 2024-05-04T07:53:17.412 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid/uuid.h... yes 2024-05-04T07:53:17.486 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/uuid.h usability... no 2024-05-04T07:53:17.527 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/uuid.h presence... no 2024-05-04T07:53:17.528 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/uuid.h... no 2024-05-04T07:53:17.599 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/file.h usability... yes 2024-05-04T07:53:17.629 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/file.h presence... yes 2024-05-04T07:53:17.629 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/file.h... yes 2024-05-04T07:53:17.709 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fcntl.h usability... yes 2024-05-04T07:53:17.738 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fcntl.h presence... yes 2024-05-04T07:53:17.739 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fcntl.h... yes 2024-05-04T07:53:17.817 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/syssgi.h usability... no 2024-05-04T07:53:17.855 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/syssgi.h presence... no 2024-05-04T07:53:17.855 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/syssgi.h... no 2024-05-04T07:53:17.943 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/param.h usability... yes 2024-05-04T07:53:17.978 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/param.h presence... yes 2024-05-04T07:53:17.978 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/param.h... yes 2024-05-04T07:53:17.998 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/stat.h... (cached) yes 2024-05-04T07:53:18.067 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/statvfs.h usability... yes 2024-05-04T07:53:18.094 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/statvfs.h presence... yes 2024-05-04T07:53:18.094 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/statvfs.h... yes 2024-05-04T07:53:18.171 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/time.h usability... yes 2024-05-04T07:53:18.201 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/time.h presence... yes 2024-05-04T07:53:18.201 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/time.h... yes 2024-05-04T07:53:18.292 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/ioctl.h usability... yes 2024-05-04T07:53:18.321 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/ioctl.h presence... yes 2024-05-04T07:53:18.321 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/ioctl.h... yes 2024-05-04T07:53:18.403 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/wait.h usability... yes 2024-05-04T07:53:18.433 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/wait.h presence... yes 2024-05-04T07:53:18.433 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/wait.h... yes 2024-05-04T07:53:18.453 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/types.h... (cached) yes 2024-05-04T07:53:18.471 INFO:teuthology.orchestra.run.smithi136.stdout:checking for strings.h... (cached) yes 2024-05-04T07:53:18.551 INFO:teuthology.orchestra.run.smithi136.stdout:checking err.h usability... yes 2024-05-04T07:53:18.580 INFO:teuthology.orchestra.run.smithi136.stdout:checking err.h presence... yes 2024-05-04T07:53:18.580 INFO:teuthology.orchestra.run.smithi136.stdout:checking for err.h... yes 2024-05-04T07:53:18.656 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/falloc.h usability... yes 2024-05-04T07:53:18.681 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/falloc.h presence... yes 2024-05-04T07:53:18.682 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/falloc.h... yes 2024-05-04T07:53:18.756 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-04T07:53:18.797 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-04T07:53:18.797 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-04T07:53:18.870 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-04T07:53:18.909 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-04T07:53:18.909 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-04T07:53:18.978 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/platform_defs.h usability... no 2024-05-04T07:53:19.021 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/platform_defs.h presence... no 2024-05-04T07:53:19.021 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/platform_defs.h... no 2024-05-04T07:53:19.094 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfs/ioctl.h usability... no 2024-05-04T07:53:19.136 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfs/ioctl.h presence... no 2024-05-04T07:53:19.136 INFO:teuthology.orchestra.run.smithi136.stdout:checking for btrfs/ioctl.h... no 2024-05-04T07:53:19.206 INFO:teuthology.orchestra.run.smithi136.stdout:checking cifs/ioctl.h usability... no 2024-05-04T07:53:19.250 INFO:teuthology.orchestra.run.smithi136.stdout:checking cifs/ioctl.h presence... no 2024-05-04T07:53:19.250 INFO:teuthology.orchestra.run.smithi136.stdout:checking for cifs/ioctl.h... no 2024-05-04T07:53:19.331 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/mman.h usability... yes 2024-05-04T07:53:19.359 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/mman.h presence... yes 2024-05-04T07:53:19.359 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/mman.h... yes 2024-05-04T07:53:19.436 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/ext4.h usability... no 2024-05-04T07:53:19.476 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/ext4.h presence... no 2024-05-04T07:53:19.476 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/ext4.h... no 2024-05-04T07:53:19.520 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xfs_log_format.h... no 2024-05-04T07:53:19.618 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid_compare... no 2024-05-04T07:53:19.693 INFO:teuthology.orchestra.run.smithi136.stdout:checking for uuid_compare in -luuid... yes 2024-05-04T07:53:19.825 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xfs.h... yes 2024-05-04T07:53:19.868 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/libxfs.h... no 2024-05-04T07:53:19.918 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-04T07:53:19.990 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/xqm.h... yes 2024-05-04T07:53:20.100 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-04T07:53:20.165 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/handle.h usability... yes 2024-05-04T07:53:20.188 INFO:teuthology.orchestra.run.smithi136.stdout:checking xfs/handle.h presence... yes 2024-05-04T07:53:20.188 INFO:teuthology.orchestra.run.smithi136.stdout:checking for xfs/handle.h... yes 2024-05-04T07:53:20.282 INFO:teuthology.orchestra.run.smithi136.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-04T07:53:20.348 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/acl.h usability... yes 2024-05-04T07:53:20.377 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/acl.h presence... yes 2024-05-04T07:53:20.377 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/acl.h... yes 2024-05-04T07:53:20.455 INFO:teuthology.orchestra.run.smithi136.stdout:checking acl/libacl.h usability... yes 2024-05-04T07:53:20.487 INFO:teuthology.orchestra.run.smithi136.stdout:checking acl/libacl.h presence... yes 2024-05-04T07:53:20.487 INFO:teuthology.orchestra.run.smithi136.stdout:checking for acl/libacl.h... yes 2024-05-04T07:53:20.567 INFO:teuthology.orchestra.run.smithi136.stdout:checking for acl_init in -lacl... yes 2024-05-04T07:53:20.628 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm-ndbm.h usability... no 2024-05-04T07:53:20.664 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm-ndbm.h presence... no 2024-05-04T07:53:20.664 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gdbm-ndbm.h... no 2024-05-04T07:53:20.724 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm/ndbm.h usability... yes 2024-05-04T07:53:20.756 INFO:teuthology.orchestra.run.smithi136.stdout:checking gdbm/ndbm.h presence... yes 2024-05-04T07:53:20.756 INFO:teuthology.orchestra.run.smithi136.stdout:checking for gdbm/ndbm.h... yes 2024-05-04T07:53:20.852 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_open in -lgdbm... no 2024-05-04T07:53:20.947 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_fetch in -lgdbm... no 2024-05-04T07:53:21.041 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_store in -lgdbm... no 2024-05-04T07:53:21.131 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_close in -lgdbm... no 2024-05-04T07:53:21.214 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-05-04T07:53:21.296 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-05-04T07:53:21.375 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-05-04T07:53:21.460 INFO:teuthology.orchestra.run.smithi136.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-05-04T07:53:21.526 INFO:teuthology.orchestra.run.smithi136.stdout:checking libaio.h usability... yes 2024-05-04T07:53:21.559 INFO:teuthology.orchestra.run.smithi136.stdout:checking libaio.h presence... yes 2024-05-04T07:53:21.559 INFO:teuthology.orchestra.run.smithi136.stdout:checking for libaio.h... yes 2024-05-04T07:53:21.627 INFO:teuthology.orchestra.run.smithi136.stdout:checking liburing.h usability... no 2024-05-04T07:53:21.667 INFO:teuthology.orchestra.run.smithi136.stdout:checking liburing.h presence... no 2024-05-04T07:53:21.667 INFO:teuthology.orchestra.run.smithi136.stdout:checking for liburing.h... no 2024-05-04T07:53:21.733 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/capability.h usability... yes 2024-05-04T07:53:21.764 INFO:teuthology.orchestra.run.smithi136.stdout:checking sys/capability.h presence... yes 2024-05-04T07:53:21.765 INFO:teuthology.orchestra.run.smithi136.stdout:checking for sys/capability.h... yes 2024-05-04T07:53:21.826 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fiemap.h usability... yes 2024-05-04T07:53:21.853 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fiemap.h presence... yes 2024-05-04T07:53:21.853 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/fiemap.h... yes 2024-05-04T07:53:21.940 INFO:teuthology.orchestra.run.smithi136.stdout:checking for fallocate... yes 2024-05-04T07:53:22.027 INFO:teuthology.orchestra.run.smithi136.stdout:checking for open_by_handle_at... yes 2024-05-04T07:53:22.092 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fs.h usability... yes 2024-05-04T07:53:22.118 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/fs.h presence... yes 2024-05-04T07:53:22.118 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/fs.h... yes 2024-05-04T07:53:22.181 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfsutil.h usability... no 2024-05-04T07:53:22.222 INFO:teuthology.orchestra.run.smithi136.stdout:checking btrfsutil.h presence... no 2024-05-04T07:53:22.223 INFO:teuthology.orchestra.run.smithi136.stdout:checking for btrfsutil.h... no 2024-05-04T07:53:22.313 INFO:teuthology.orchestra.run.smithi136.stdout:checking for copy_file_range... yes 2024-05-04T07:53:22.397 INFO:teuthology.orchestra.run.smithi136.stdout:checking for SEEK_DATA... yes 2024-05-04T07:53:22.507 INFO:teuthology.orchestra.run.smithi136.stdout:checking for BMV_OF_SHARED... yes 2024-05-04T07:53:22.596 INFO:teuthology.orchestra.run.smithi136.stdout:checking for nftw... yes 2024-05-04T07:53:22.693 INFO:teuthology.orchestra.run.smithi136.stdout:checking for RLIMIT_NOFILE... yes 2024-05-04T07:53:22.772 INFO:teuthology.orchestra.run.smithi136.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-04T07:53:22.859 INFO:teuthology.orchestra.run.smithi136.stdout:checking for FICLONE... yes 2024-05-04T07:53:22.947 INFO:teuthology.orchestra.run.smithi136.stdout:checking for renameat2... yes 2024-05-04T07:53:23.030 INFO:teuthology.orchestra.run.smithi136.stdout:checking for reallocarray... yes 2024-05-04T07:53:23.132 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct mount_attr... yes 2024-05-04T07:53:23.241 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-04T07:53:23.344 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-04T07:53:23.447 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-04T07:53:23.554 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-04T07:53:23.661 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-04T07:53:23.766 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-04T07:53:23.874 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-04T07:53:23.950 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs.h usability... yes 2024-05-04T07:53:23.973 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs.h presence... yes 2024-05-04T07:53:23.974 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/btrfs.h... yes 2024-05-04T07:53:24.050 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-04T07:53:24.079 INFO:teuthology.orchestra.run.smithi136.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-04T07:53:24.080 INFO:teuthology.orchestra.run.smithi136.stdout:checking for linux/btrfs_tree.h... yes 2024-05-04T07:53:24.144 INFO:teuthology.orchestra.run.smithi136.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-04T07:53:24.214 INFO:teuthology.orchestra.run.smithi136.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-04T07:53:24.248 INFO:teuthology.orchestra.run.smithi136.stdout:configure: creating ./config.status 2024-05-04T07:53:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: creating include/builddefs 2024-05-04T07:53:25.411 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: creating include/config.h 2024-05-04T07:53:25.444 INFO:teuthology.orchestra.run.smithi136.stdout:config.status: executing libtool commands 2024-05-04T07:53:25.548 INFO:teuthology.orchestra.run.smithi136.stdout:Building include 2024-05-04T07:53:25.558 INFO:teuthology.orchestra.run.smithi136.stdout:Building lib 2024-05-04T07:53:25.568 INFO:teuthology.orchestra.run.smithi136.stdout: [LTDEP] 2024-05-04T07:53:25.900 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dataascii.lo 2024-05-04T07:53:26.165 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] databin.lo 2024-05-04T07:53:26.457 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] datapid.lo 2024-05-04T07:53:26.706 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] file_lock.lo 2024-05-04T07:53:26.998 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] forker.lo 2024-05-04T07:53:27.267 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] pattern.lo 2024-05-04T07:53:27.516 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] open_flags.lo 2024-05-04T07:53:27.798 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] random_range.lo 2024-05-04T07:53:28.181 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] string_to_tokens.lo 2024-05-04T07:53:28.427 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] str_to_bytes.lo 2024-05-04T07:53:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] tlibio.lo 2024-05-04T07:53:29.114 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] write_log.lo 2024-05-04T07:53:29.505 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] random.lo 2024-05-04T07:53:29.748 INFO:teuthology.orchestra.run.smithi136.stdout: [LD] 2024-05-04T07:53:29.954 INFO:teuthology.orchestra.run.smithi136.stdout:Building ltp 2024-05-04T07:53:29.964 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:30.235 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] doio 2024-05-04T07:53:31.140 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsstress 2024-05-04T07:53:32.761 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsx 2024-05-04T07:53:33.708 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] growfiles 2024-05-04T07:53:34.387 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] iogen 2024-05-04T07:53:34.968 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-stress 2024-05-04T07:53:35.600 INFO:teuthology.orchestra.run.smithi136.stdout:Building src 2024-05-04T07:53:35.611 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:39.491 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:39.563 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:39.585 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:40.066 INFO:teuthology.orchestra.run.smithi136.stdout: [DEP] 2024-05-04T07:53:40.118 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirstress 2024-05-04T07:53:40.544 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fill 2024-05-04T07:53:40.869 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fill2 2024-05-04T07:53:41.280 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] getpagesize 2024-05-04T07:53:41.568 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] holes 2024-05-04T07:53:41.946 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] lstat64 2024-05-04T07:53:42.297 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] nametest 2024-05-04T07:53:42.709 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] permname 2024-05-04T07:53:43.077 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] randholes 2024-05-04T07:53:43.517 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] runas 2024-05-04T07:53:43.862 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] truncfile 2024-05-04T07:53:44.194 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] usemem 2024-05-04T07:53:44.483 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmapcat 2024-05-04T07:53:44.772 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:53:44.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:53:44.785 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] append_reader 2024-05-04T07:53:45.055 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] append_writer 2024-05-04T07:53:45.344 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirperf 2024-05-04T07:53:45.756 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] metaperf 2024-05-04T07:53:46.187 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] devzero 2024-05-04T07:53:46.552 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] feature 2024-05-04T07:53:46.933 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] alloc 2024-05-04T07:53:47.318 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fault 2024-05-04T07:53:47.661 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fstest 2024-05-04T07:53:48.086 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_access_root 2024-05-04T07:53:48.414 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] godown 2024-05-04T07:53:48.748 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] resvtest 2024-05-04T07:53:49.082 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] writemod 2024-05-04T07:53:49.371 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] writev_on_pagefault 2024-05-04T07:53:49.689 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] makeextents 2024-05-04T07:53:50.049 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] itrash 2024-05-04T07:53:50.352 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] rename 2024-05-04T07:53:50.655 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] multi_open_unlink 2024-05-04T07:53:50.978 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] unwritten_sync 2024-05-04T07:53:51.328 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] genhashnames 2024-05-04T07:53:51.695 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_holes 2024-05-04T07:53:52.014 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_writev 2024-05-04T07:53:52.340 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_truncate_cmtime 2024-05-04T07:53:52.675 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dirhash_collide 2024-05-04T07:53:53.064 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_rename_overwrite 2024-05-04T07:53:53.383 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] holetest 2024-05-04T07:53:53.787 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_truncate_self 2024-05-04T07:53:54.079 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] af_unix 2024-05-04T07:53:54.433 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_stale_pmd 2024-05-04T07:53:54.746 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_cow_race 2024-05-04T07:53:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_fallocate 2024-05-04T07:53:55.395 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsync-err 2024-05-04T07:53:55.746 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_write_ro 2024-05-04T07:53:56.041 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-04T07:53:56.369 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-04T07:53:56.697 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_ofd_locks 2024-05-04T07:53:57.069 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_collision 2024-05-04T07:53:57.433 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmap-write-concurrent 2024-05-04T07:53:57.784 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_get_file_time 2024-05-04T07:53:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_create_short_dirs 2024-05-04T07:53:58.454 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_create_long_dirs 2024-05-04T07:53:58.792 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_enospc 2024-05-04T07:53:59.183 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_writev_overlap 2024-05-04T07:53:59.506 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] checkpoint_journal 2024-05-04T07:53:59.808 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mmap-rw-fault 2024-05-04T07:54:00.137 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] allocstale 2024-05-04T07:54:00.474 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_cow_memory_failure 2024-05-04T07:54:00.821 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fake-dump-rootino 2024-05-04T07:54:01.140 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-buf-fault 2024-05-04T07:54:01.448 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] rewinddir-test 2024-05-04T07:54:01.790 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] readdir-while-renames 2024-05-04T07:54:02.128 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] xfsctl 2024-05-04T07:54:02.495 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bstat 2024-05-04T07:54:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mtab 2024-05-04T07:54:03.264 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] getdevicesize 2024-05-04T07:54:03.581 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] preallo_rw_pattern_reader 2024-05-04T07:54:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] preallo_rw_pattern_writer 2024-05-04T07:54:04.254 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] ftrunc 2024-05-04T07:54:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] trunc 2024-05-04T07:54:04.885 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fs_perms 2024-05-04T07:54:05.223 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] testx 2024-05-04T07:54:05.527 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] looptest 2024-05-04T07:54:05.897 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] locktest 2024-05-04T07:54:06.392 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] unwritten_mmap 2024-05-04T07:54:06.690 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_unlink_test 2024-05-04T07:54:07.066 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] deduperace 2024-05-04T07:54:07.438 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_unlink_test_modified 2024-05-04T07:54:07.821 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_offset 2024-05-04T07:54:08.119 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_futimens 2024-05-04T07:54:08.415 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_immutable 2024-05-04T07:54:09.225 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] stale_handle 2024-05-04T07:54:09.540 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] pwrite_mmap_blocked 2024-05-04T07:54:09.866 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_offset2 2024-05-04T07:54:10.238 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] seek_sanity_test 2024-05-04T07:54:10.896 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] seek_copy_test 2024-05-04T07:54:11.258 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_1 2024-05-04T07:54:11.584 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_2 2024-05-04T07:54:11.907 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fsync-tester 2024-05-04T07:54:12.328 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] nsexec 2024-05-04T07:54:12.673 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] cloner 2024-05-04T07:54:13.002 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] renameat2 2024-05-04T07:54:13.325 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_getcwd 2024-05-04T07:54:13.644 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] e4compact 2024-05-04T07:54:14.021 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] test-nextquota 2024-05-04T07:54:14.373 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] punch-alternating 2024-05-04T07:54:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-04T07:54:14.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:54:14.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:54:15.022 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] listxattr 2024-05-04T07:54:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-interleaved 2024-05-04T07:54:15.653 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_dir_type 2024-05-04T07:54:15.985 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dio-invalidate-cache 2024-05-04T07:54:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] stat_test 2024-05-04T07:54:16.794 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_encrypted_d_revalidate 2024-05-04T07:54:17.109 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] attr_replace_test 2024-05-04T07:54:17.430 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] swapon 2024-05-04T07:54:17.768 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mkswap 2024-05-04T07:54:18.064 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_attr_corruption 2024-05-04T07:54:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_open_tmpfiles 2024-05-04T07:54:18.706 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fscrypt-crypt-util 2024-05-04T07:54:19.563 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] bulkstat_null_ocount 2024-05-04T07:54:19.889 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] splice-test 2024-05-04T07:54:20.220 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] chprojid_fail 2024-05-04T07:54:20.549 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] detached_mounts_propagation 2024-05-04T07:54:20.885 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] ext4_resize 2024-05-04T07:54:21.201 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_readdir_3 2024-05-04T07:54:21.588 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] splice2pipe 2024-05-04T07:54:21.926 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] uuid_ioctl 2024-05-04T07:54:22.241 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-04T07:54:22.567 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fiemap-fault 2024-05-04T07:54:22.900 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fiemap-tester 2024-05-04T07:54:23.350 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_stripealign 2024-05-04T07:54:23.659 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] open_by_handle 2024-05-04T07:54:24.097 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] dbtest 2024-05-04T07:54:24.536 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_mmap_dio 2024-05-04T07:54:24.874 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] xfsfind 2024-05-04T07:54:25.252 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] t_reflink_read_race 2024-05-04T07:54:25.603 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] fssum 2024-05-04T07:54:26.257 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2024-05-04T07:54:26.271 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] replay-log 2024-05-04T07:54:26.770 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2024-05-04T07:54:26.781 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2024-05-04T07:54:26.797 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aiocp 2024-05-04T07:54:27.187 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-04T07:54:27.533 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-append-write-read-race 2024-05-04T07:54:27.881 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-cow-race 2024-05-04T07:54:28.193 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-cycle-write 2024-05-04T07:54:28.524 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-eof-race 2024-05-04T07:54:28.880 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-extend-stat 2024-05-04T07:54:29.180 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-fcntl-race 2024-05-04T07:54:29.508 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-hole-filling-race 2024-05-04T07:54:29.830 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-invalidate-failure 2024-05-04T07:54:30.158 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-invalidate-readahead 2024-05-04T07:54:30.449 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aiodio_sparse2 2024-05-04T07:54:30.844 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-subblock-eof-read 2024-05-04T07:54:31.135 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-dio-write-verify 2024-05-04T07:54:31.499 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-04T07:54:31.797 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-04T07:54:32.077 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] aio-last-ref-held-by-io 2024-05-04T07:54:32.400 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2024-05-04T07:54:32.415 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] vfstest 2024-05-04T07:54:36.353 INFO:teuthology.orchestra.run.smithi136.stdout: [CC] mount-idmapped 2024-05-04T07:54:36.878 INFO:teuthology.orchestra.run.smithi136.stdout:Building m4 2024-05-04T07:54:36.887 INFO:teuthology.orchestra.run.smithi136.stdout:Building common 2024-05-04T07:54:36.897 INFO:teuthology.orchestra.run.smithi136.stdout:Building tests 2024-05-04T07:54:36.911 INFO:teuthology.orchestra.run.smithi136.stdout:Building btrfs 2024-05-04T07:54:36.926 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/btrfs/group.list 2024-05-04T07:54:37.161 INFO:teuthology.orchestra.run.smithi136.stdout:Building ceph 2024-05-04T07:54:37.177 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ceph/group.list 2024-05-04T07:54:37.228 INFO:teuthology.orchestra.run.smithi136.stdout:Building cifs 2024-05-04T07:54:37.242 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/cifs/group.list 2024-05-04T07:54:37.288 INFO:teuthology.orchestra.run.smithi136.stdout:Building ext4 2024-05-04T07:54:37.302 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ext4/group.list 2024-05-04T07:54:37.443 INFO:teuthology.orchestra.run.smithi136.stdout:Building f2fs 2024-05-04T07:54:37.458 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/f2fs/group.list 2024-05-04T07:54:37.522 INFO:teuthology.orchestra.run.smithi136.stdout:Building generic 2024-05-04T07:54:37.539 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/generic/group.list 2024-05-04T07:54:37.890 INFO:teuthology.orchestra.run.smithi136.stdout:Building nfs 2024-05-04T07:54:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/nfs/group.list 2024-05-04T07:54:37.957 INFO:teuthology.orchestra.run.smithi136.stdout:Building ocfs2 2024-05-04T07:54:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ocfs2/group.list 2024-05-04T07:54:38.022 INFO:teuthology.orchestra.run.smithi136.stdout:Building overlay 2024-05-04T07:54:38.036 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/overlay/group.list 2024-05-04T07:54:38.182 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2024-05-04T07:54:38.195 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/perf/group.list 2024-05-04T07:54:38.236 INFO:teuthology.orchestra.run.smithi136.stdout:Building selftest 2024-05-04T07:54:38.251 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/selftest/group.list 2024-05-04T07:54:38.296 INFO:teuthology.orchestra.run.smithi136.stdout:Building shared 2024-05-04T07:54:38.311 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/shared/group.list 2024-05-04T07:54:38.371 INFO:teuthology.orchestra.run.smithi136.stdout:Building tmpfs 2024-05-04T07:54:38.384 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/tmpfs/group.list 2024-05-04T07:54:38.433 INFO:teuthology.orchestra.run.smithi136.stdout:Building udf 2024-05-04T07:54:38.447 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/udf/group.list 2024-05-04T07:54:38.487 INFO:teuthology.orchestra.run.smithi136.stdout:Building xfs 2024-05-04T07:54:38.504 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/xfs/group.list 2024-05-04T07:54:38.877 DEBUG:teuthology.orchestra.run.smithi136:> (cd /tmp/tmp.V8XnAFKYKlxfstests-dev && exec sudo make install) 2024-05-04T07:54:38.988 INFO:teuthology.orchestra.run.smithi136.stdout:Building include 2024-05-04T07:54:38.997 INFO:teuthology.orchestra.run.smithi136.stdout:Building lib 2024-05-04T07:54:39.008 INFO:teuthology.orchestra.run.smithi136.stdout:Building ltp 2024-05-04T07:54:39.019 INFO:teuthology.orchestra.run.smithi136.stdout:Building src 2024-05-04T07:54:39.106 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2024-05-04T07:54:39.116 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2024-05-04T07:54:39.126 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2024-05-04T07:54:39.138 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2024-05-04T07:54:39.149 INFO:teuthology.orchestra.run.smithi136.stdout:Building m4 2024-05-04T07:54:39.159 INFO:teuthology.orchestra.run.smithi136.stdout:Building common 2024-05-04T07:54:39.168 INFO:teuthology.orchestra.run.smithi136.stdout:Building tests 2024-05-04T07:54:39.182 INFO:teuthology.orchestra.run.smithi136.stdout:Building btrfs 2024-05-04T07:54:39.197 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/btrfs/group.list 2024-05-04T07:54:39.432 INFO:teuthology.orchestra.run.smithi136.stdout:Building ceph 2024-05-04T07:54:39.446 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ceph/group.list 2024-05-04T07:54:39.499 INFO:teuthology.orchestra.run.smithi136.stdout:Building cifs 2024-05-04T07:54:39.514 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/cifs/group.list 2024-05-04T07:54:39.559 INFO:teuthology.orchestra.run.smithi136.stdout:Building ext4 2024-05-04T07:54:39.574 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ext4/group.list 2024-05-04T07:54:39.719 INFO:teuthology.orchestra.run.smithi136.stdout:Building f2fs 2024-05-04T07:54:39.734 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/f2fs/group.list 2024-05-04T07:54:39.797 INFO:teuthology.orchestra.run.smithi136.stdout:Building generic 2024-05-04T07:54:39.815 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/generic/group.list 2024-05-04T07:54:40.164 INFO:teuthology.orchestra.run.smithi136.stdout:Building nfs 2024-05-04T07:54:40.178 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/nfs/group.list 2024-05-04T07:54:40.230 INFO:teuthology.orchestra.run.smithi136.stdout:Building ocfs2 2024-05-04T07:54:40.243 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ocfs2/group.list 2024-05-04T07:54:40.292 INFO:teuthology.orchestra.run.smithi136.stdout:Building overlay 2024-05-04T07:54:40.306 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/overlay/group.list 2024-05-04T07:54:40.452 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2024-05-04T07:54:40.467 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/perf/group.list 2024-05-04T07:54:40.507 INFO:teuthology.orchestra.run.smithi136.stdout:Building selftest 2024-05-04T07:54:40.522 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/selftest/group.list 2024-05-04T07:54:40.568 INFO:teuthology.orchestra.run.smithi136.stdout:Building shared 2024-05-04T07:54:40.583 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/shared/group.list 2024-05-04T07:54:40.646 INFO:teuthology.orchestra.run.smithi136.stdout:Building tmpfs 2024-05-04T07:54:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/tmpfs/group.list 2024-05-04T07:54:40.706 INFO:teuthology.orchestra.run.smithi136.stdout:Building udf 2024-05-04T07:54:40.720 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/udf/group.list 2024-05-04T07:54:40.761 INFO:teuthology.orchestra.run.smithi136.stdout:Building xfs 2024-05-04T07:54:40.778 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/xfs/group.list 2024-05-04T07:54:41.114 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-04T07:54:41.117 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-04T07:54:41.118 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-04T07:54:41.122 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-04T07:54:41.123 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-04T07:54:41.127 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-04T07:54:41.159 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-04T07:54:41.396 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-04T07:54:41.429 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-04T07:54:41.473 INFO:teuthology.orchestra.run.smithi136.stdout:Building log-writes 2024-05-04T07:54:41.483 INFO:teuthology.orchestra.run.smithi136.stdout:Building perf 2024-05-04T07:54:41.493 INFO:teuthology.orchestra.run.smithi136.stdout:Building aio-dio-regress 2024-05-04T07:54:41.505 INFO:teuthology.orchestra.run.smithi136.stdout:Building vfs 2024-05-04T07:54:41.513 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C log-writes install 2024-05-04T07:54:41.517 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-04T07:54:41.549 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-04T07:54:41.581 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C perf install 2024-05-04T07:54:41.585 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-04T07:54:41.615 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-04T07:54:41.697 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-04T07:54:41.702 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-04T07:54:41.734 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-04T07:54:41.940 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake -C vfs install 2024-05-04T07:54:41.943 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-04T07:54:41.976 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-04T07:54:42.021 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-04T07:54:42.050 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-04T07:54:45.026 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:54:45.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:54:46.386 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-04T07:54:46.734 INFO:teuthology.orchestra.run.smithi136.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-04T07:54:46.805 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-04T07:54:46.808 INFO:teuthology.orchestra.run.smithi136.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-04T07:54:46.809 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-04T07:54:46.812 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-04T07:54:46.844 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-04T07:54:47.344 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-04T07:54:47.348 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/btrfs/ install 2024-05-04T07:54:47.354 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/btrfs/group.list 2024-05-04T07:54:47.564 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-04T07:54:47.595 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 330 /var/lib/xfstests/tests/btrfs 2024-05-04T07:54:50.995 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-04T07:54:51.028 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-04T07:54:54.616 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ceph/ install 2024-05-04T07:54:54.622 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ceph/group.list 2024-05-04T07:54:54.668 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-04T07:54:54.697 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-04T07:54:54.764 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-04T07:54:54.796 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-04T07:54:54.869 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/cifs/ install 2024-05-04T07:54:54.876 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/cifs/group.list 2024-05-04T07:54:54.917 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-04T07:54:54.948 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-04T07:54:54.979 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-04T07:54:55.011 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-04T07:54:55.045 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ext4/ install 2024-05-04T07:54:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ext4/group.list 2024-05-04T07:54:55.196 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-04T07:54:55.227 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-04T07:54:55.923 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-04T07:54:55.955 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-04T07:54:56.696 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/f2fs/ install 2024-05-04T07:54:56.703 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/f2fs/group.list 2024-05-04T07:54:56.764 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-04T07:54:56.795 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-04T07:54:56.835 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-04T07:54:56.864 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-04T07:54:56.906 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/generic/ install 2024-05-04T07:54:56.913 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/generic/group.list 2024-05-04T07:54:57.266 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-04T07:54:57.298 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 /var/lib/xfstests/tests/generic 2024-05-04T07:55:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-04T07:55:05.437 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out /var/lib/xfstests/tests/generic 2024-05-04T07:55:12.932 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/nfs/ install 2024-05-04T07:55:12.939 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/nfs/group.list 2024-05-04T07:55:12.988 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-04T07:55:13.018 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-04T07:55:13.047 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-04T07:55:13.077 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-04T07:55:13.111 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ocfs2/ install 2024-05-04T07:55:13.118 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/ocfs2/group.list 2024-05-04T07:55:13.163 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-04T07:55:13.194 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-04T07:55:13.225 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-04T07:55:13.258 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-04T07:55:13.289 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/overlay/ install 2024-05-04T07:55:13.296 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/overlay/group.list 2024-05-04T07:55:13.440 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-04T07:55:13.469 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-04T07:55:14.564 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-04T07:55:14.597 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-04T07:55:15.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:55:15.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:55:15.647 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/perf/ install 2024-05-04T07:55:15.654 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/perf/group.list 2024-05-04T07:55:15.692 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-04T07:55:15.724 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-04T07:55:15.756 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-04T07:55:15.789 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-04T07:55:15.822 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/selftest/ install 2024-05-04T07:55:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/selftest/group.list 2024-05-04T07:55:15.871 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-04T07:55:15.902 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-04T07:55:15.983 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-04T07:55:16.014 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-04T07:55:16.098 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/shared/ install 2024-05-04T07:55:16.104 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/shared/group.list 2024-05-04T07:55:16.165 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-04T07:55:16.197 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-04T07:55:16.248 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-04T07:55:16.277 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-04T07:55:16.324 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/tmpfs/ install 2024-05-04T07:55:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/tmpfs/group.list 2024-05-04T07:55:16.378 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-04T07:55:16.409 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-04T07:55:16.441 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-04T07:55:16.472 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-04T07:55:16.506 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/udf/ install 2024-05-04T07:55:16.514 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/udf/group.list 2024-05-04T07:55:16.552 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-04T07:55:16.585 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-04T07:55:16.616 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-04T07:55:16.646 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-04T07:55:16.679 INFO:teuthology.orchestra.run.smithi136.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/xfs/ install 2024-05-04T07:55:16.689 INFO:teuthology.orchestra.run.smithi136.stdout: [GROUP] /tmp/tmp.V8XnAFKYKlxfstests-dev/tests/xfs/group.list 2024-05-04T07:55:17.042 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-04T07:55:17.074 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-04T07:55:24.423 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-04T07:55:24.453 INFO:teuthology.orchestra.run.smithi136.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-04T07:55:32.163 INFO:teuthology.orchestra.run.smithi136.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-04T07:55:32.196 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-04T07:55:32.228 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-04T07:55:32.260 INFO:teuthology.orchestra.run.smithi136.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-04T07:55:32.296 INFO:tasks.cephfs.test_acls:client is kernel mounted 2024-05-04T07:55:32.296 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-04T07:55:32.297 DEBUG:teuthology.orchestra.run.smithi136:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.V8XnAFKYKlxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-04T07:55:32.816 INFO:teuthology.orchestra.run.smithi136.stdout:FSTYP -- ceph 2024-05-04T07:55:32.828 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM -- Linux/x86_64 smithi136 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 2024-05-04T07:55:32.830 INFO:teuthology.orchestra.run.smithi136.stdout:MKFS_OPTIONS -- 172.21.15.136:6789:/scratch 2024-05-04T07:55:32.832 INFO:teuthology.orchestra.run.smithi136.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB86DVmWHp8GBAAjjXrjse7hK3mShim0Guy/g== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.IpKHCzrTQkscratch 2024-05-04T07:55:32.832 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:35.193 INFO:teuthology.orchestra.run.smithi136.stdout:generic/099 2s 2024-05-04T07:55:35.209 INFO:teuthology.orchestra.run.smithi136.stdout:Ran: generic/099 2024-05-04T07:55:35.210 INFO:teuthology.orchestra.run.smithi136.stdout:Passed all 1 tests 2024-05-04T07:55:35.218 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:35.302 INFO:tasks.cephfs.test_acls:Command return value: 0 2024-05-04T07:55:35.302 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi136 6.9.0-rc3-g806ec36b2112 #1 SMP PREEMPT_DYNAMIC Fri Apr 19 09:08:57 UTC 2024 MKFS_OPTIONS -- 172.21.15.136:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQB86DVmWHp8GBAAjjXrjse7hK3mShim0Guy/g== -o context=system_u:object_r:root_t:s0 172.21.15.136:6789:/scratch /tmp/tmp.IpKHCzrTQkscratch generic/099 2s Ran: generic/099 Passed all 1 tests 2024-05-04T07:55:35.302 INFO:tasks.cephfs.test_acls:Command stderr - 2024-05-04T07:55:35.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo userdel --force --remove fsgqa 2024-05-04T07:55:35.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo userdel --force --remove 123456-fsgqa 2024-05-04T07:55:36.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo groupdel fsgqa 2024-05-04T07:55:36.707 INFO:teuthology.orchestra.run.smithi136.stderr:groupdel: group 'fsgqa' does not exist 2024-05-04T07:55:36.712 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-04T07:55:36.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:36.712 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.V8XnAFKYKlxfstests-dev/results) 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout: File: /tmp/tmp.V8XnAFKYKlxfstests-dev/results 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 801h/2049d Inode: 555905 Links: 3 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-04 07:55:32.770038667 +0000 2024-05-04T07:55:36.791 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-04 07:55:35.204985318 +0000 2024-05-04T07:55:36.792 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-04 07:55:35.204985318 +0000 2024-05-04T07:55:36.792 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-04 07:55:32.770038667 +0000 2024-05-04T07:55:36.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:36.795 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-05-04T07:55:36.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:36.877 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.V8XnAFKYKlxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-05-04T07:55:36.961 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.V8XnAFKYKlxfstests-dev to /var/log/ceph. 2024-05-04T07:55:36.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf /tmp/tmp.V8XnAFKYKlxfstests-dev 2024-05-04T07:55:37.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-04T07:55:37.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-04T07:55:37.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-04T07:55:37.506 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-04T07:55:37.506 INFO:tasks.cephfs.mount:Terminating background process 2024-05-04T07:55:37.506 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:55:37.506 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:37.563 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:55:37.563 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:37.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T07:55:37.818 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.817+0000 7f6722800640 1 Processor -- start 2024-05-04T07:55:37.819 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.817+0000 7f6722800640 1 -- start start 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.818+0000 7f6722800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f671c0720b0 0x7f671c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.818+0000 7f6722800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c0cc090 con 0x7f671c15f2d0 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.818+0000 7f6722800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c0d0240 con 0x7f671c163540 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.818+0000 7f6722800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f671c0cbb10 con 0x7f671c0720b0 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.819+0000 7f671b400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f671c15f2d0 0x7f671c162e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:32790/0 (socket says 172.21.15.136:32790) 2024-05-04T07:55:37.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.819+0000 7f671b400640 1 -- 172.21.15.136:0/662023800 learned_addr learned my addr 172.21.15.136:0/662023800 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.819+0000 7f671be00640 1 --2- 172.21.15.136:0/662023800 >> v2:172.21.15.142:3300/0 conn(0x7f671c0720b0 0x7f671c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.819+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634576005 0 0) 0x7f671c0cc090 con 0x7f671c15f2d0 2024-05-04T07:55:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.819+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6700003520 con 0x7f671c15f2d0 2024-05-04T07:55:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3872141993 0 0) 0x7f6700003520 con 0x7f671c15f2d0 2024-05-04T07:55:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 >> v2:172.21.15.142:3300/0 conn(0x7f671c0720b0 msgr2=0x7f671c0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 --2- 172.21.15.136:0/662023800 >> v2:172.21.15.142:3300/0 conn(0x7f671c0720b0 0x7f671c0cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 >> v1:172.21.15.142:6789/0 conn(0x7f671c163540 legacy=0x7f671c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c0d0520 con 0x7f671c15f2d0 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f670c001a90 con 0x7f671c15f2d0 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 >> v1:172.21.15.136:6789/0 conn(0x7f671c15f2d0 legacy=0x7f671c162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6700003a50 0x7f6700003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700004800 0x7f6700004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 0x7f670000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f671c0cbb10 con 0x7f67000052e0 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f670000c1b0 con 0x7f6700004800 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f670000c3b0 con 0x7f6700003a50 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f671be00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 0x7f670000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.820+0000 7f6712a00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700004800 0x7f6700004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f671be00640 1 -- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6700003a50 msgr2=0x7f6700003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f671be00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6700003a50 0x7f6700003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f671be00640 1 -- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700004800 msgr2=0x7f6700004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f671be00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700004800 0x7f6700004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f671be00640 1 -- 172.21.15.136:0/662023800 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6700003520 con 0x7f67000052e0 2024-05-04T07:55:37.825 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.821+0000 7f6712a00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700004800 0x7f6700004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:37.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.822+0000 7f671be00640 1 -- 172.21.15.136:0/662023800 reap_dead start 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.822+0000 7f671be00640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 0x7f670000b9c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f671c0740d0 tx=0x7f6700005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52eaae320f34bd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.822+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714030070 con 0x7f67000052e0 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.822+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f671402ad80 con 0x7f67000052e0 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.822+0000 7f671aa00640 1 -- 172.21.15.136:0/662023800 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400b5e0 con 0x7f67000052e0 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 -- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 msgr2=0x7f670000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 0x7f670000b9c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f671c0740d0 tx=0x7f6700005830 comp rx=0 tx=0).stop 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 -- 172.21.15.136:0/662023800 shutdown_connections 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 --2- 172.21.15.136:0/662023800 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67000052e0 0x7f670000b9c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 -- 172.21.15.136:0/662023800 >> 172.21.15.136:0/662023800 conn(0x7f671c0d0c50 msgr2=0x7f671c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 -- 172.21.15.136:0/662023800 shutdown_connections 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.823+0000 7f6722800640 1 -- 172.21.15.136:0/662023800 wait complete. 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.825+0000 7f6722800640 1 Processor -- start 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.825+0000 7f6722800640 1 -- start start 2024-05-04T07:55:37.829 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 0x7f671c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f671c0724e0 0x7f671c072960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f671c163b30 con 0x7f671c0c61a0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f671c0cc370 con 0x7f671c0724e0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6722800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f671c0ca1e0 con 0x7f67000052e0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6712a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6712a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46138/0 (socket says 172.21.15.136:46138) 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f6712a00640 1 -- 172.21.15.136:0/4078785145 learned_addr learned my addr 172.21.15.136:0/4078785145 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f671be00640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f671c0724e0 0x7f671c072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.826+0000 7f671b400640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 0x7f671c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 -- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 msgr2=0x7f671c158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 0x7f671c158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 -- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f671c0724e0 msgr2=0x7f671c072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f671c0724e0 0x7f671c072960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 -- 172.21.15.136:0/4078785145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c0c93a0 con 0x7f671c0c61a0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f671b400640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 0x7f671c158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6712a00640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f670400d7d0 tx=0x7f670400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704005270 con 0x7f671c0c61a0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6704017070 con 0x7f671c0c61a0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670400b6b0 con 0x7f671c0c61a0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c0c6620 con 0x7f671c0c61a0 2024-05-04T07:55:37.831 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.827+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c0c9940 con 0x7f671c0c61a0 2024-05-04T07:55:37.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.829+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671c069470 con 0x7f671c0c61a0 2024-05-04T07:55:37.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.830+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f670400b870 con 0x7f671c0c61a0 2024-05-04T07:55:37.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.831+0000 7f6713e00640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 0x7f66f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:37.833 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.831+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f6704097710 con 0x7f671c0c61a0 2024-05-04T07:55:37.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.831+0000 7f671b400640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 0x7f66f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:37.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.832+0000 7f671b400640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 0x7f66f8078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f670c001c00 tx=0x7f670c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:37.841 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:37.840+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6704060e20 con 0x7f671c0c61a0 2024-05-04T07:55:38.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.064+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f671c0cea60 con 0x7f671c0c61a0 2024-05-04T07:55:38.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.064+0000 7f6713e00640 1 -- 172.21.15.136:0/4078785145 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f6704060720 con 0x7f671c0c61a0 2024-05-04T07:55:38.066 INFO:teuthology.orchestra.run.smithi136.stderr:listed 0 entries 2024-05-04T07:55:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.067+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 msgr2=0x7f66f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.067+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 0x7f66f8078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f670c001c00 tx=0x7f670c009040 comp rx=0 tx=0).stop 2024-05-04T07:55:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.067+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 msgr2=0x7f671c0c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.067+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f670400d7d0 tx=0x7f670400dc90 comp rx=0 tx=0).stop 2024-05-04T07:55:38.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 shutdown_connections 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f66f80762d0 0x7f66f8078790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f671c0724e0 0x7f671c072960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f671c0c61a0 0x7f671c0c8e60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 --2- 172.21.15.136:0/4078785145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67000052e0 0x7f671c158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 >> 172.21.15.136:0/4078785145 conn(0x7f671c0d0c50 msgr2=0x7f671c073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 shutdown_connections 2024-05-04T07:55:38.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.068+0000 7f6722800640 1 -- 172.21.15.136:0/4078785145 wait complete. 2024-05-04T07:55:38.089 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-04T07:55:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:38.090 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-04T07:55:38.188 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:55:38.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:38.189 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-04T07:55:38.243 INFO:tasks.cephfs.mount:Terminating background process 2024-05-04T07:55:38.243 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:55:38.243 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:38.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-04T07:55:38.305 INFO:tasks.cephfs.mount:Terminating background process 2024-05-04T07:55:38.305 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:55:38.305 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:38.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-04T07:55:38.363 INFO:tasks.cephfs.mount:Terminating background process 2024-05-04T07:55:38.364 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:55:38.364 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:38.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-04T07:55:38.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:55:38.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.636+0000 7f2bd1200640 1 Processor -- start 2024-05-04T07:55:38.637 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.636+0000 7f2bd1200640 1 -- start start 2024-05-04T07:55:38.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.637+0000 7f2bd1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.637+0000 7f2bd1200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2bcc0afbc0 0x7f2bcc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.637+0000 7f2bd1200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bcc0ceb20 con 0x7f2bcc0cc6e0 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.637+0000 7f2bd1200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2bcc15faa0 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.637+0000 7f2bd1200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2bcc0ce8d0 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.638+0000 7f2bcbe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2bcc0afbc0 0x7f2bcc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.639 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.638+0000 7f2bcb400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.638+0000 7f2bcb400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:53032/0 (socket says 172.21.15.136:53032) 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.638+0000 7f2bcb400640 1 -- 172.21.15.136:0/3023991235 learned_addr learned my addr 172.21.15.136:0/3023991235 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.639+0000 7f2bcb400640 1 -- 172.21.15.136:0/3023991235 >> v2:172.21.15.142:3300/0 conn(0x7f2bcc0afbc0 msgr2=0x7f2bcc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.639+0000 7f2bcb400640 1 --2- 172.21.15.136:0/3023991235 >> v2:172.21.15.142:3300/0 conn(0x7f2bcc0afbc0 0x7f2bcc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.639+0000 7f2bcb400640 1 -- 172.21.15.136:0/3023991235 >> v1:172.21.15.142:6789/0 conn(0x7f2bcc0cc6e0 legacy=0x7f2bcc072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.639+0000 7f2bcb400640 1 -- 172.21.15.136:0/3023991235 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc0cee00 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.640+0000 7f2bcb400640 1 --2- 172.21.15.136:0/3023991235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009870 tx=0x7f2bbc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5090354894f4d9b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:38.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.640+0000 7f2bca000640 1 -- 172.21.15.136:0/3023991235 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc037070 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.640+0000 7f2bca000640 1 -- 172.21.15.136:0/3023991235 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc032440 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.640+0000 7f2bca000640 1 -- 172.21.15.136:0/3023991235 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc032810 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 -- 172.21.15.136:0/3023991235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 msgr2=0x7f2bcc0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3023991235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009870 tx=0x7f2bbc02a1c0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 -- 172.21.15.136:0/3023991235 shutdown_connections 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3023991235 >> v2:172.21.15.142:3300/0 conn(0x7f2bcc0afbc0 0x7f2bcc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3023991235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc15f6c0 0x7f2bcc0cb020 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 -- 172.21.15.136:0/3023991235 >> 172.21.15.136:0/3023991235 conn(0x7f2bcc0d09d0 msgr2=0x7f2bcc0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 -- 172.21.15.136:0/3023991235 shutdown_connections 2024-05-04T07:55:38.643 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.641+0000 7f2bd1200640 1 -- 172.21.15.136:0/3023991235 wait complete. 2024-05-04T07:55:38.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.643+0000 7f2bd1200640 1 Processor -- start 2024-05-04T07:55:38.644 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.643+0000 7f2bd1200640 1 -- start start 2024-05-04T07:55:38.645 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc0cc6e0 0x7f2bcc0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bcc15f6c0 0x7f2bcc152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc0cace0 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc073d70 con 0x7f2bcc15f6c0 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bd1200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2bcc0cae60 con 0x7f2bcc0cc6e0 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bcb400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bcb400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46146/0 (socket says 172.21.15.136:46146) 2024-05-04T07:55:38.646 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.644+0000 7f2bcb400640 1 -- 172.21.15.136:0/3268490583 learned_addr learned my addr 172.21.15.136:0/3268490583 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcbe00640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bcc15f6c0 0x7f2bcc152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcaa00640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc0cc6e0 0x7f2bcc0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 -- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc0cc6e0 msgr2=0x7f2bcc0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc0cc6e0 0x7f2bcc0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 -- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bcc15f6c0 msgr2=0x7f2bcc152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bcc15f6c0 0x7f2bcc152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 -- 172.21.15.136:0/3268490583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc0c55c0 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bcb400640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc000c00 tx=0x7f2bbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc037040 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc042070 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc030860 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.645+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc0b6830 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.646+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc0c5b10 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.647+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc069400 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.648+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bbc02ad10 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.649+0000 7f2bc3400640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:38.650 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.649+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f2bbc0b7db0 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.649+0000 7f2bcaa00640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:38.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.650+0000 7f2bcaa00640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc069e50 tx=0x7f2bb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:38.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.653+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bbc081500 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.901+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bcc06eb00 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.902+0000 7f2bc3400640 1 -- 172.21.15.136:0/3268490583 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7f2bbc080e00 con 0x7f2bcc0afbc0 2024-05-04T07:55:38.903 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:38.904 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:55:38.904 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:55:38.906 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 msgr2=0x7f2bac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc069e50 tx=0x7f2bb8009040 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 msgr2=0x7f2bcc0b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc000c00 tx=0x7f2bbc0046c0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 shutdown_connections 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2bcc15f6c0 0x7f2bcc152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2bcc0cc6e0 0x7f2bcc0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 --2- 172.21.15.136:0/3268490583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bcc0afbc0 0x7f2bcc0b62f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 >> 172.21.15.136:0/3268490583 conn(0x7f2bcc0d09d0 msgr2=0x7f2bcc06f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 shutdown_connections 2024-05-04T07:55:38.907 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:38.905+0000 7f2bd1200640 1 -- 172.21.15.136:0/3268490583 wait complete. 2024-05-04T07:55:38.927 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:55:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.118+0000 7fdd35200640 1 Processor -- start 2024-05-04T07:55:39.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.118+0000 7fdd35200640 1 -- start start 2024-05-04T07:55:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.119+0000 7fdd35200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd300b1c60 0x7fdd300d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd35200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdd300b31f0 0x7fdd300b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd35200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd300b2170 con 0x7fdd300d3460 2024-05-04T07:55:39.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd35200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdd300b2430 con 0x7fdd300b31f0 2024-05-04T07:55:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd35200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdd300b2710 con 0x7fdd300b1c60 2024-05-04T07:55:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2fe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdd300b31f0 0x7fdd300b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2f400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdd300d3460 0x7fdd300d3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:32800/0 (socket says 172.21.15.136:32800) 2024-05-04T07:55:39.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2f400640 1 -- 172.21.15.136:0/1141919178 learned_addr learned my addr 172.21.15.136:0/1141919178 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2ea00640 1 --2- 172.21.15.136:0/1141919178 >> v2:172.21.15.142:3300/0 conn(0x7fdd300b1c60 0x7fdd300d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1141919178 >> v2:172.21.15.142:3300/0 conn(0x7fdd300b1c60 msgr2=0x7fdd300d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.120+0000 7fdd2fe00640 1 --2- 172.21.15.136:0/1141919178 >> v2:172.21.15.142:3300/0 conn(0x7fdd300b1c60 0x7fdd300d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.121+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1141919178 >> v1:172.21.15.136:6789/0 conn(0x7fdd300d3460 legacy=0x7fdd300d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.121+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1141919178 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd300b29f0 con 0x7fdd300b31f0 2024-05-04T07:55:39.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.121+0000 7fdd2e000640 1 -- 172.21.15.136:0/1141919178 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758911050 0 0) 0x7fdd300b2170 con 0x7fdd300d3460 2024-05-04T07:55:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.122+0000 7fdd2fe00640 1 --2- 172.21.15.136:0/1141919178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300b31f0 0x7fdd300b3640 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd2802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48110fd79040c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.122+0000 7fdd2e000640 1 -- 172.21.15.136:0/1141919178 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28031600 con 0x7fdd300b31f0 2024-05-04T07:55:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.122+0000 7fdd2e000640 1 -- 172.21.15.136:0/1141919178 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd280317a0 con 0x7fdd300b31f0 2024-05-04T07:55:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.122+0000 7fdd2e000640 1 -- 172.21.15.136:0/1141919178 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28031b70 con 0x7fdd300b31f0 2024-05-04T07:55:39.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 -- 172.21.15.136:0/1141919178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300b31f0 msgr2=0x7fdd300b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 --2- 172.21.15.136:0/1141919178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300b31f0 0x7fdd300b3640 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd2802a610 comp rx=0 tx=0).stop 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 -- 172.21.15.136:0/1141919178 shutdown_connections 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 --2- 172.21.15.136:0/1141919178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300b31f0 0x7fdd300b3640 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 --2- 172.21.15.136:0/1141919178 >> v2:172.21.15.142:3300/0 conn(0x7fdd300b1c60 0x7fdd300d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 -- 172.21.15.136:0/1141919178 >> 172.21.15.136:0/1141919178 conn(0x7fdd3009e370 msgr2=0x7fdd300d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 -- 172.21.15.136:0/1141919178 shutdown_connections 2024-05-04T07:55:39.125 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.123+0000 7fdd35200640 1 -- 172.21.15.136:0/1141919178 wait complete. 2024-05-04T07:55:39.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.125+0000 7fdd35200640 1 Processor -- start 2024-05-04T07:55:39.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.125+0000 7fdd35200640 1 -- start start 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 0x7fdd3015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300b31f0 0x7fdd3006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdd30163ae0 con 0x7fdd300d3460 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdd300d5f00 con 0x7fdd300b31f0 2024-05-04T07:55:39.128 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd35200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdd30163c60 con 0x7fdd300b1c60 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd2fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd2fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46166/0 (socket says 172.21.15.136:46166) 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1792940520 learned_addr learned my addr 172.21.15.136:0/1792940520 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd2f400640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 0x7fdd3015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.126+0000 7fdd2ea00640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300b31f0 0x7fdd3006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 msgr2=0x7fdd3015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 0x7fdd3015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300b31f0 msgr2=0x7fdd3006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300b31f0 0x7fdd3006cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 -- 172.21.15.136:0/1792940520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3015bd00 con 0x7fdd300d3460 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2f400640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 0x7fdd3015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:39.129 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd2fe00640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2803f070 con 0x7fdd300d3460 2024-05-04T07:55:39.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd28030b60 con 0x7fdd300d3460 2024-05-04T07:55:39.130 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28009450 con 0x7fdd300d3460 2024-05-04T07:55:39.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd300cd1c0 con 0x7fdd300d3460 2024-05-04T07:55:39.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.127+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd300cd780 con 0x7fdd300d3460 2024-05-04T07:55:39.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.129+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd30069400 con 0x7fdd300d3460 2024-05-04T07:55:39.131 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.130+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd2803b410 con 0x7fdd300d3460 2024-05-04T07:55:39.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.131+0000 7fdd27400640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.131+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fdd280b8680 con 0x7fdd300d3460 2024-05-04T07:55:39.132 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.131+0000 7fdd2f400640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.133 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.132+0000 7fdd2f400640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 0x7fdd10078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdd20001220 tx=0x7fdd20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.135+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd28081e20 con 0x7fdd300d3460 2024-05-04T07:55:39.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.383+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd300b2170 con 0x7fdd300d3460 2024-05-04T07:55:39.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.384+0000 7fdd27400640 1 -- 172.21.15.136:0/1792940520 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7fdd28081720 con 0x7fdd300d3460 2024-05-04T07:55:39.386 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:39.386 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:55:39.386 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:55:39.389 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 msgr2=0x7fdd10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 0x7fdd10078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdd20001220 tx=0x7fdd20009040 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 msgr2=0x7fdd3006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009d90 tx=0x7fdd28004a40 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 shutdown_connections 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd300d3460 0x7fdd3006d440 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd300b31f0 0x7fdd3006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 --2- 172.21.15.136:0/1792940520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd300b1c60 0x7fdd3015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 >> 172.21.15.136:0/1792940520 conn(0x7fdd3009e370 msgr2=0x7fdd30160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 shutdown_connections 2024-05-04T07:55:39.390 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.388+0000 7fdd35200640 1 -- 172.21.15.136:0/1792940520 wait complete. 2024-05-04T07:55:39.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:55:39.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.601+0000 7f529e600640 1 Processor -- start 2024-05-04T07:55:39.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.601+0000 7f529e600640 1 -- start start 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f529e600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f529814cd70 0x7f52980c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f529e600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f529814d150 0x7f52980c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f529e600640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52980cfe20 con 0x7f52980cb490 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f529e600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f52980c75f0 con 0x7f529814d150 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f529e600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f52980c7030 con 0x7f529814cd70 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f528ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f529814d150 0x7f52980c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f528ea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f529814d150 0x7f52980c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46174/0 (socket says 172.21.15.136:46174) 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.602+0000 7f528ea00640 1 -- 172.21.15.136:0/375585329 learned_addr learned my addr 172.21.15.136:0/375585329 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:39.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f5297400640 1 --2- 172.21.15.136:0/375585329 >> v2:172.21.15.142:3300/0 conn(0x7f529814cd70 0x7f52980c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f528ea00640 1 -- 172.21.15.136:0/375585329 >> v2:172.21.15.142:3300/0 conn(0x7f529814cd70 msgr2=0x7f52980c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f528ea00640 1 --2- 172.21.15.136:0/375585329 >> v2:172.21.15.142:3300/0 conn(0x7f529814cd70 0x7f52980c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f528ea00640 1 -- 172.21.15.136:0/375585329 >> v1:172.21.15.136:6789/0 conn(0x7f52980cb490 legacy=0x7f52980ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f528ea00640 1 -- 172.21.15.136:0/375585329 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52980c7310 con 0x7f529814d150 2024-05-04T07:55:39.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.603+0000 7f5296a00640 1 -- 172.21.15.136:0/375585329 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469550667 0 0) 0x7f52980cfe20 con 0x7f52980cb490 2024-05-04T07:55:39.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.604+0000 7f528ea00640 1 --2- 172.21.15.136:0/375585329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f529814d150 0x7f52980c6a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52980c78e0 tx=0x7f528002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d708138158855 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.604+0000 7f5296a00640 1 -- 172.21.15.136:0/375585329 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280037070 con 0x7f529814d150 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.604+0000 7f5296a00640 1 -- 172.21.15.136:0/375585329 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5280032440 con 0x7f529814d150 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.604+0000 7f5296a00640 1 -- 172.21.15.136:0/375585329 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280032810 con 0x7f529814d150 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 -- 172.21.15.136:0/375585329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f529814d150 msgr2=0x7f52980c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 --2- 172.21.15.136:0/375585329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f529814d150 0x7f52980c6a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52980c78e0 tx=0x7f528002a270 comp rx=0 tx=0).stop 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 -- 172.21.15.136:0/375585329 shutdown_connections 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 --2- 172.21.15.136:0/375585329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f529814d150 0x7f52980c6a00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 --2- 172.21.15.136:0/375585329 >> v2:172.21.15.142:3300/0 conn(0x7f529814cd70 0x7f52980c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 -- 172.21.15.136:0/375585329 >> 172.21.15.136:0/375585329 conn(0x7f52980d0c30 msgr2=0x7f52980d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 -- 172.21.15.136:0/375585329 shutdown_connections 2024-05-04T07:55:39.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.605+0000 7f529e600640 1 -- 172.21.15.136:0/375585329 wait complete. 2024-05-04T07:55:39.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.607+0000 7f529e600640 1 Processor -- start 2024-05-04T07:55:39.608 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.607+0000 7f529e600640 1 -- start start 2024-05-04T07:55:39.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529814cd70 0x7f52981498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f529814d150 0x7f5298149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f52980738a0 con 0x7f52980cb490 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5298072370 con 0x7f529814d150 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f529e600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5298073a20 con 0x7f529814cd70 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f5297400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f5297400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46180/0 (socket says 172.21.15.136:46180) 2024-05-04T07:55:39.610 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.608+0000 7f5297400640 1 -- 172.21.15.136:0/2093193842 learned_addr learned my addr 172.21.15.136:0/2093193842 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:39.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 -- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529814cd70 msgr2=0x7f52981498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529814cd70 0x7f52981498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 -- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f529814d150 msgr2=0x7f5298149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297e00640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f529814d150 0x7f5298149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.611 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f529814d150 0x7f5298149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 -- 172.21.15.136:0/2093193842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52981f8e10 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f5297400640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f528800d800 tx=0x7f528800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528800b6c0 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5288019070 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528800ba80 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52981f90f0 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.609+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52981f96b0 con 0x7f52980cb490 2024-05-04T07:55:39.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.610+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5298069400 con 0x7f52980cb490 2024-05-04T07:55:39.613 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.612+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f528800bc20 con 0x7f52980cb490 2024-05-04T07:55:39.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.613+0000 7f528fe00640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 0x7f5274078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:39.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.613+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f5288097d20 con 0x7f52980cb490 2024-05-04T07:55:39.614 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.613+0000 7f528ea00640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 0x7f5274078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:39.615 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.613+0000 7f528ea00640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 0x7f5274078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5280034000 tx=0x7f528002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:39.618 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.617+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5288061430 con 0x7f52980cb490 2024-05-04T07:55:39.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.820+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5298074060 con 0x7f52980cb490 2024-05-04T07:55:39.824 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.823+0000 7f528fe00640 1 -- 172.21.15.136:0/2093193842 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16995 (secure 0 0 0) 0x7f5288060d30 con 0x7f52980cb490 2024-05-04T07:55:39.825 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:39.825 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":41,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:52:09.412985+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:51:41.545546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-04T07:51:42.525458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:55:39.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.825+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 msgr2=0x7f5274078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.827 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.825+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 0x7f5274078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5280034000 tx=0x7f528002c000 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.825+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 msgr2=0x7f52980b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.825+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f528800d800 tx=0x7f528800dcc0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 shutdown_connections 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f52740762d0 0x7f5274078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f529814d150 0x7f5298149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529814cd70 0x7f52981498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 --2- 172.21.15.136:0/2093193842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52980cb490 0x7f52980b1e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 >> 172.21.15.136:0/2093193842 conn(0x7f52980d0c30 msgr2=0x7f5298072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 shutdown_connections 2024-05-04T07:55:39.828 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:39.826+0000 7f529e600640 1 -- 172.21.15.136:0/2093193842 wait complete. 2024-05-04T07:55:39.847 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-04T07:55:39.847 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:55:40.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.047+0000 7f750e000640 1 Processor -- start 2024-05-04T07:55:40.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.047+0000 7f750e000640 1 -- start start 2024-05-04T07:55:40.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 0x7f750806dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750e000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75080cb730 0x7f750806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750e000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75080ceb20 con 0x7f750815f6c0 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750e000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f750815faa0 con 0x7f75080cb730 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f75080ce8d0 con 0x7f75080cc6e0 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75080cb730 0x7f750806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75080cb730 0x7f750806e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46190/0 (socket says 172.21.15.136:46190) 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750cc00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f750815f6c0 0x7f75080cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:32816/0 (socket says 172.21.15.136:32816) 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 -- 172.21.15.136:0/1011594551 learned_addr learned my addr 172.21.15.136:0/1011594551 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:40.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f74ffe00640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 0x7f750806dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 -- 172.21.15.136:0/1011594551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 msgr2=0x7f750806dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 0x7f750806dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.049+0000 7f750d600640 1 -- 172.21.15.136:0/1011594551 >> v1:172.21.15.136:6789/0 conn(0x7f750815f6c0 legacy=0x7f75080cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.050+0000 7f750d600640 1 -- 172.21.15.136:0/1011594551 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75080cee00 con 0x7f75080cb730 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.050+0000 7f7507e00640 1 -- 172.21.15.136:0/1011594551 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619798203 0 0) 0x7f75080ceb20 con 0x7f750815f6c0 2024-05-04T07:55:40.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.050+0000 7f74ffe00640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 0x7f750806dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f750d600640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f750806e2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7500009e50 tx=0x7f750002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8833425799c64b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f7507e00640 1 -- 172.21.15.136:0/1011594551 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500036070 con 0x7f75080cb730 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f7507e00640 1 -- 172.21.15.136:0/1011594551 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500031600 con 0x7f75080cb730 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f7507e00640 1 -- 172.21.15.136:0/1011594551 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75000319d0 con 0x7f75080cb730 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f750e000640 1 -- 172.21.15.136:0/1011594551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 msgr2=0x7f750806e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.051+0000 7f750e000640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f750806e2b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7500009e50 tx=0x7f750002a680 comp rx=0 tx=0).stop 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 -- 172.21.15.136:0/1011594551 shutdown_connections 2024-05-04T07:55:40.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f750806e2b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 --2- 172.21.15.136:0/1011594551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f75080cc6e0 0x7f750806dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 -- 172.21.15.136:0/1011594551 >> 172.21.15.136:0/1011594551 conn(0x7f75080d09d0 msgr2=0x7f75080d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:40.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 -- 172.21.15.136:0/1011594551 shutdown_connections 2024-05-04T07:55:40.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.052+0000 7f750e000640 1 -- 172.21.15.136:0/1011594551 wait complete. 2024-05-04T07:55:40.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.053+0000 7f750e000640 1 Processor -- start 2024-05-04T07:55:40.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.053+0000 7f750e000640 1 -- start start 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75080cc6e0 0x7f7508159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f750815f6c0 0x7f7508159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7508073740 con 0x7f75080cb730 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7508073d70 con 0x7f75080cc6e0 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.054+0000 7f750e000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f75080cace0 con 0x7f750815f6c0 2024-05-04T07:55:40.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46202/0 (socket says 172.21.15.136:46202) 2024-05-04T07:55:40.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 -- 172.21.15.136:0/840739080 learned_addr learned my addr 172.21.15.136:0/840739080 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 -- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f750815f6c0 msgr2=0x7f7508159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750d600640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f750815f6c0 0x7f7508159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f750815f6c0 0x7f7508159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 -- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75080cc6e0 msgr2=0x7f7508159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75080cc6e0 0x7f7508159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 -- 172.21.15.136:0/840739080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75080c8280 con 0x7f75080cb730 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.055+0000 7f750cc00640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74f000c410 tx=0x7f74f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.056+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f00074e0 con 0x7f75080cb730 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.056+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f00047e0 con 0x7f75080cb730 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.056+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0004bd0 con 0x7f75080cb730 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.056+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75080c8560 con 0x7f75080cb730 2024-05-04T07:55:40.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.056+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75080c8b20 con 0x7f75080cb730 2024-05-04T07:55:40.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.057+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7508069400 con 0x7f75080cb730 2024-05-04T07:55:40.059 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.058+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74f0011070 con 0x7f75080cb730 2024-05-04T07:55:40.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.059+0000 7f7505600640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 0x7f74e4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.059+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f74f00973e0 con 0x7f75080cb730 2024-05-04T07:55:40.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.060+0000 7f74ffe00640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 0x7f74e4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.060+0000 7f74ffe00640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 0x7f74e4078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006fd0 tx=0x7f74f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.064+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f74f0060b80 con 0x7f75080cb730 2024-05-04T07:55:40.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.317+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75080c8f20 con 0x7f75080cb730 2024-05-04T07:55:40.319 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.318+0000 7f7505600640 1 -- 172.21.15.136:0/840739080 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7f74f0060480 con 0x7f75080cb730 2024-05-04T07:55:40.320 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:40.320 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:55:40.320 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:55:40.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 msgr2=0x7f74e4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.322 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 0x7f74e4078790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f74f8006fd0 tx=0x7f74f8008040 comp rx=0 tx=0).stop 2024-05-04T07:55:40.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 msgr2=0x7f75080b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74f000c410 tx=0x7f74f000c8d0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 shutdown_connections 2024-05-04T07:55:40.323 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f74e40762d0 0x7f74e4078790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f750815f6c0 0x7f7508159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75080cc6e0 0x7f7508159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 --2- 172.21.15.136:0/840739080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75080cb730 0x7f75080b38e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.321+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 >> 172.21.15.136:0/840739080 conn(0x7f75080d09d0 msgr2=0x7f750806e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.322+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 shutdown_connections 2024-05-04T07:55:40.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.322+0000 7f750e000640 1 -- 172.21.15.136:0/840739080 wait complete. 2024-05-04T07:55:40.343 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:55:40.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.531+0000 7fe7cf200640 1 Processor -- start 2024-05-04T07:55:40.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.531+0000 7fe7cf200640 1 -- start start 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7d015f6c0 0x7fe7d00cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7d00cc6e0 0x7fe7d00cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d00afbc0 0x7fe7d0072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d015faa0 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d00ce8d0 con 0x7fe7d015f6c0 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7cf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d00ceb20 con 0x7fe7d00afbc0 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.532+0000 7fe7c5400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7d00cc6e0 0x7fe7d00cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7d00cc6e0 0x7fe7d00cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46210/0 (socket says 172.21.15.136:46210) 2024-05-04T07:55:40.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 -- 172.21.15.136:0/1408096901 learned_addr learned my addr 172.21.15.136:0/1408096901 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:40.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7ce800640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d00afbc0 0x7fe7d0072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 -- 172.21.15.136:0/1408096901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d00afbc0 msgr2=0x7fe7d0072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:40.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d00afbc0 0x7fe7d0072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 -- 172.21.15.136:0/1408096901 >> v2:172.21.15.142:3300/0 conn(0x7fe7d015f6c0 msgr2=0x7fe7d00cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:40.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 --2- 172.21.15.136:0/1408096901 >> v2:172.21.15.142:3300/0 conn(0x7fe7d015f6c0 0x7fe7d00cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.533+0000 7fe7c5400640 1 -- 172.21.15.136:0/1408096901 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00cee00 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.534+0000 7fe7c5400640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d00cb560 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0076250 tx=0x7fe7b802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2870a0a352c284e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.534+0000 7fe7cd400640 1 -- 172.21.15.136:0/1408096901 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8037070 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.534+0000 7fe7cd400640 1 -- 172.21.15.136:0/1408096901 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b8032440 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.534+0000 7fe7cd400640 1 -- 172.21.15.136:0/1408096901 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8032810 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 -- 172.21.15.136:0/1408096901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 msgr2=0x7fe7d00cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d00cb560 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0076250 tx=0x7fe7b802a140 comp rx=0 tx=0).stop 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 -- 172.21.15.136:0/1408096901 shutdown_connections 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d00afbc0 0x7fe7d0072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 --2- 172.21.15.136:0/1408096901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d00cb560 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 --2- 172.21.15.136:0/1408096901 >> v2:172.21.15.142:3300/0 conn(0x7fe7d015f6c0 0x7fe7d00cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 -- 172.21.15.136:0/1408096901 >> 172.21.15.136:0/1408096901 conn(0x7fe7d00d09d0 msgr2=0x7fe7d00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 -- 172.21.15.136:0/1408096901 shutdown_connections 2024-05-04T07:55:40.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.535+0000 7fe7cf200640 1 -- 172.21.15.136:0/1408096901 wait complete. 2024-05-04T07:55:40.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.537+0000 7fe7cf200640 1 Processor -- start 2024-05-04T07:55:40.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.537+0000 7fe7cf200640 1 -- start start 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7d00afbc0 0x7fe7d00c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d015f6c0 0x7fe7d0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d00cace0 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0073d70 con 0x7fe7d00afbc0 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d00cae60 con 0x7fe7d015f6c0 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46214/0 (socket says 172.21.15.136:46214) 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 -- 172.21.15.136:0/2111960611 learned_addr learned my addr 172.21.15.136:0/2111960611 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 -- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d015f6c0 msgr2=0x7fe7d0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.540 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d015f6c0 0x7fe7d0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7cde00640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7d00afbc0 0x7fe7d00c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 -- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7d00afbc0 msgr2=0x7fe7d00c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7d00afbc0 0x7fe7d00c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.538+0000 7fe7c5400640 1 -- 172.21.15.136:0/2111960611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d0153680 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7c5400640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8000c00 tx=0x7fe7b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8041070 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b803c870 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8037040 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d00c87a0 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.539+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d00c8d60 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.540+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d0069400 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.541+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7b8044070 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.543+0000 7fe7c6a00640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 0x7fe7ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.543+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fe7b80b8360 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.543+0000 7fe7cde00640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 0x7fe7ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:40.544 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.543+0000 7fe7cde00640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 0x7fe7ac078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000a770 tx=0x7fe7c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:40.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.547+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7b8081b00 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.791 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.789+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7d00cf270 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.792 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.791+0000 7fe7c6a00640 1 -- 172.21.15.136:0/2111960611 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5193 (secure 0 0 0) 0x7fe7b8081400 con 0x7fe7d00cc6e0 2024-05-04T07:55:40.792 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:40.793 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T07:51:43.553260+0000","modified":"2024-05-04T07:51:46.592685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.136:6837/2426434001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2426434001},{"type":"v1","addr":"172.21.15.136:6837","nonce":2426434001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-05-04T07:55:40.793 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 19 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 msgr2=0x7fe7ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 0x7fe7ac078790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000a770 tx=0x7fe7c0008040 comp rx=0 tx=0).stop 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 msgr2=0x7fe7d01503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8000c00 tx=0x7fe7b80046c0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 shutdown_connections 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe7ac0762d0 0x7fe7ac078790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7d015f6c0 0x7fe7d0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d00cc6e0 0x7fe7d01503e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 --2- 172.21.15.136:0/2111960611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7d00afbc0 0x7fe7d00c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:40.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 >> 172.21.15.136:0/2111960611 conn(0x7fe7d00d09d0 msgr2=0x7fe7d00cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:40.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 shutdown_connections 2024-05-04T07:55:40.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:40.793+0000 7fe7cf200640 1 -- 172.21.15.136:0/2111960611 wait complete. 2024-05-04T07:55:40.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:55:41.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.004+0000 7f5be9e00640 1 Processor -- start 2024-05-04T07:55:41.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.004+0000 7f5be9e00640 1 -- start start 2024-05-04T07:55:41.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.005+0000 7f5be9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be4145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.005+0000 7f5be9e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be4146900 con 0x7f5be41463a0 2024-05-04T07:55:41.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.005+0000 7f5be9e00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be415d7f0 con 0x7f5be4072600 2024-05-04T07:55:41.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.005+0000 7f5be9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5be4140320 con 0x7f5be413ff40 2024-05-04T07:55:41.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.006+0000 7f5bdbe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5be41463a0 0x7f5be4071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:32832/0 (socket says 172.21.15.136:32832) 2024-05-04T07:55:41.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.006+0000 7f5bdbe00640 1 -- 172.21.15.136:0/34472013 learned_addr learned my addr 172.21.15.136:0/34472013 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:41.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.006+0000 7f5be2a00640 1 --2- 172.21.15.136:0/34472013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be4145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.007+0000 7f5be2a00640 1 -- 172.21.15.136:0/34472013 >> v1:172.21.15.142:6789/0 conn(0x7f5be4072600 legacy=0x7f5be40c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.007+0000 7f5be2a00640 1 -- 172.21.15.136:0/34472013 >> v1:172.21.15.136:6789/0 conn(0x7f5be41463a0 legacy=0x7f5be4071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.009 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.007+0000 7f5be2a00640 1 -- 172.21.15.136:0/34472013 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be415dad0 con 0x7f5be413ff40 2024-05-04T07:55:41.010 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.009+0000 7f5be2a00640 1 --2- 172.21.15.136:0/34472013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be4145e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40097d0 tx=0x7f5bd402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d520760c37cdf038 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.013+0000 7f5be2000640 1 -- 172.21.15.136:0/34472013 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4037070 con 0x7f5be413ff40 2024-05-04T07:55:41.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.013+0000 7f5be2000640 1 -- 172.21.15.136:0/34472013 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd4032440 con 0x7f5be413ff40 2024-05-04T07:55:41.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.013+0000 7f5be2000640 1 -- 172.21.15.136:0/34472013 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4032810 con 0x7f5be413ff40 2024-05-04T07:55:41.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 -- 172.21.15.136:0/34472013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 msgr2=0x7f5be4145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 --2- 172.21.15.136:0/34472013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be4145e60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40097d0 tx=0x7f5bd402a200 comp rx=0 tx=0).stop 2024-05-04T07:55:41.016 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 -- 172.21.15.136:0/34472013 shutdown_connections 2024-05-04T07:55:41.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 --2- 172.21.15.136:0/34472013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be4145e60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 -- 172.21.15.136:0/34472013 >> 172.21.15.136:0/34472013 conn(0x7f5be40d0c30 msgr2=0x7f5be40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:41.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 -- 172.21.15.136:0/34472013 shutdown_connections 2024-05-04T07:55:41.017 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.014+0000 7f5be9e00640 1 -- 172.21.15.136:0/34472013 wait complete. 2024-05-04T07:55:41.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.016+0000 7f5be9e00640 1 Processor -- start 2024-05-04T07:55:41.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.016+0000 7f5be9e00640 1 -- start start 2024-05-04T07:55:41.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5be4072600 0x7f5be4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be41fd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.020 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5be415d4a0 con 0x7f5be41463a0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5be415de40 con 0x7f5be4072600 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be9e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5be415e2d0 con 0x7f5be413ff40 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.017+0000 7f5be3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46216/0 (socket says 172.21.15.136:46216) 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 -- 172.21.15.136:0/3675525143 learned_addr learned my addr 172.21.15.136:0/3675525143 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5bdbe00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be41fd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be2a00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5be4072600 0x7f5be4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 -- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 msgr2=0x7f5be41fd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be41fd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 -- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5be4072600 msgr2=0x7f5be4156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5be4072600 0x7f5be4156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 -- 172.21.15.136:0/3675525143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be41f9820 con 0x7f5be41463a0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.018+0000 7f5be3400640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c730 tx=0x7f5bdc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.021 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.019+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc003b70 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.019+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc003d10 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.019+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be40b3dd0 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.019+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0052f0 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.019+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be40b4390 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.020+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be4069400 con 0x7f5be41463a0 2024-05-04T07:55:41.022 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.021+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5bdc0056a0 con 0x7f5be41463a0 2024-05-04T07:55:41.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.022+0000 7f5bdb400640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 0x7f5bc0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.022+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f5bdc097870 con 0x7f5be41463a0 2024-05-04T07:55:41.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.022+0000 7f5be2a00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 0x7f5bc0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.023+0000 7f5be2a00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 0x7f5bc0078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4034000 tx=0x7f5bd402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.027 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.026+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5bdc060f80 con 0x7f5be41463a0 2024-05-04T07:55:41.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.219+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5be415d280 con 0x7f5be41463a0 2024-05-04T07:55:41.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.222+0000 7f5bdb400640 1 -- 172.21.15.136:0/3675525143 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16995 (secure 0 0 0) 0x7f5bdc060880 con 0x7f5be41463a0 2024-05-04T07:55:41.224 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:41.224 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":41,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:52:09.412985+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-04T07:51:41.545546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-04T07:51:42.525458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2b","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:55:41.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.224+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 msgr2=0x7f5bc0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.224+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 0x7f5bc0078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4034000 tx=0x7f5bd402e000 comp rx=0 tx=0).stop 2024-05-04T07:55:41.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.224+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 msgr2=0x7f5be41f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.224+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c730 tx=0x7f5bdc00cbf0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.224+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 shutdown_connections 2024-05-04T07:55:41.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f5bc00762d0 0x7f5bc0078790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5be41463a0 0x7f5be41f92e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5be413ff40 0x7f5be41fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 --2- 172.21.15.136:0/3675525143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5be4072600 0x7f5be4156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 >> 172.21.15.136:0/3675525143 conn(0x7f5be40d0c30 msgr2=0x7f5be415f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:41.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 shutdown_connections 2024-05-04T07:55:41.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.225+0000 7f5be9e00640 1 -- 172.21.15.136:0/3675525143 wait complete. 2024-05-04T07:55:41.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-04T07:55:41.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.438+0000 7fb6e3e00640 1 Processor -- start 2024-05-04T07:55:41.440 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.439+0000 7fb6e3e00640 1 -- start start 2024-05-04T07:55:41.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40cb340 0x7fb6e40c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb6e40ce5e0 0x7fb6e40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e40ccfa0 con 0x7fb6e4145ad0 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e4145eb0 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e40cd280 con 0x7fb6e40cb340 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e3400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb6e40ce5e0 0x7fb6e40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e2a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb6e4145ad0 0x7fb6e40c62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:32838/0 (socket says 172.21.15.136:32838) 2024-05-04T07:55:41.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.440+0000 7fb6e2a00640 1 -- 172.21.15.136:0/3810448571 learned_addr learned my addr 172.21.15.136:0/3810448571 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:41.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6dbe00640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40cb340 0x7fb6e40c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6e3400640 1 -- 172.21.15.136:0/3810448571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40cb340 msgr2=0x7fb6e40c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:41.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6e3400640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40cb340 0x7fb6e40c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6e3400640 1 -- 172.21.15.136:0/3810448571 >> v1:172.21.15.136:6789/0 conn(0x7fb6e4145ad0 legacy=0x7fb6e40c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.443 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6e3400640 1 -- 172.21.15.136:0/3810448571 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e40d0460 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.441+0000 7fb6e2000640 1 -- 172.21.15.136:0/3810448571 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679124771 0 0) 0x7fb6e40ccfa0 con 0x7fb6e4145ad0 2024-05-04T07:55:41.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e3400640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40ce5e0 0x7fb6e40cea70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc009d90 tx=0x7fb6dc02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da507c744b018b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e2000640 1 -- 172.21.15.136:0/3810448571 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc02ae60 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e2000640 1 -- 172.21.15.136:0/3810448571 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc007740 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e2000640 1 -- 172.21.15.136:0/3810448571 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc007b10 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e3e00640 1 -- 172.21.15.136:0/3810448571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40ce5e0 msgr2=0x7fb6e40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.442+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40ce5e0 0x7fb6e40cea70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc009d90 tx=0x7fb6dc02a640 comp rx=0 tx=0).stop 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 -- 172.21.15.136:0/3810448571 shutdown_connections 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40ce5e0 0x7fb6e40cea70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/3810448571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40cb340 0x7fb6e40c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 -- 172.21.15.136:0/3810448571 >> 172.21.15.136:0/3810448571 conn(0x7fb6e40cd490 msgr2=0x7fb6e40cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 -- 172.21.15.136:0/3810448571 shutdown_connections 2024-05-04T07:55:41.445 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.443+0000 7fb6e3e00640 1 -- 172.21.15.136:0/3810448571 wait complete. 2024-05-04T07:55:41.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.444+0000 7fb6e3e00640 1 Processor -- start 2024-05-04T07:55:41.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.444+0000 7fb6e3e00640 1 -- start start 2024-05-04T07:55:41.447 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40ce5e0 0x7fb6e40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e4145ad0 0x7fb6e40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40ccbc0 con 0x7fb6e40cb340 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40c6f30 con 0x7fb6e4145ad0 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.445+0000 7fb6e3e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e40ccd40 con 0x7fb6e40ce5e0 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46226/0 (socket says 172.21.15.136:46226) 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 -- 172.21.15.136:0/1903530373 learned_addr learned my addr 172.21.15.136:0/1903530373 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6dbe00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40ce5e0 0x7fb6e40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e3400640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e4145ad0 0x7fb6e40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 -- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40ce5e0 msgr2=0x7fb6e40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40ce5e0 0x7fb6e40c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 -- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e4145ad0 msgr2=0x7fb6e40c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e4145ad0 0x7fb6e40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.448 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 -- 172.21.15.136:0/1903530373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e40c92f0 con 0x7fb6e40cb340 2024-05-04T07:55:41.449 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6e2a00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400c410 tx=0x7fb6d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.446+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40074e0 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.447+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40047e0 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.447+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4004bd0 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.447+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e40c95c0 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.447+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e413e2c0 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.448+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e4069400 con 0x7fb6e40cb340 2024-05-04T07:55:41.450 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.449+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6d4011070 con 0x7fb6e40cb340 2024-05-04T07:55:41.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.450+0000 7fb6daa00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 0x7fb6c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.450+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fb6d40973c0 con 0x7fb6e40cb340 2024-05-04T07:55:41.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.450+0000 7fb6dbe00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 0x7fb6c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.452 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.451+0000 7fb6dbe00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 0x7fb6c0078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc006fd0 tx=0x7fb6cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.455 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.454+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6d4060b60 con 0x7fb6e40cb340 2024-05-04T07:55:41.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.681+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb6e40ce2c0 con 0x7fb6e40cb340 2024-05-04T07:55:41.684 INFO:tasks.ceph.mon.a.smithi136.stderr:2024-05-04T07:55:41.682+0000 7f11a5600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-04T07:55:41.688 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.686+0000 7fb6daa00640 1 -- 172.21.15.136:0/1903530373 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fb6d4060460 con 0x7fb6e40cb340 2024-05-04T07:55:41.688 INFO:teuthology.orchestra.run.smithi136.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-04T07:55:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.689+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 msgr2=0x7fb6c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.689+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 0x7fb6c0078790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc006fd0 tx=0x7fb6cc008040 comp rx=0 tx=0).stop 2024-05-04T07:55:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.689+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 msgr2=0x7fb6e41331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.689+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400c410 tx=0x7fb6d400c8d0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 shutdown_connections 2024-05-04T07:55:41.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fb6c00762d0 0x7fb6c0078790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb6e4145ad0 0x7fb6e40c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6e40ce5e0 0x7fb6e40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 --2- 172.21.15.136:0/1903530373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6e40cb340 0x7fb6e41331d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 >> 172.21.15.136:0/1903530373 conn(0x7fb6e40cd490 msgr2=0x7fb6e4073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:41.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 shutdown_connections 2024-05-04T07:55:41.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.691+0000 7fb6e3e00640 1 -- 172.21.15.136:0/1903530373 wait complete. 2024-05-04T07:55:41.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-04T07:55:41.797 INFO:tasks.ceph.mds.a.smithi136.stdout:starting mds.a at 2024-05-04T07:55:41.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.906+0000 7f4381200640 1 Processor -- start 2024-05-04T07:55:41.908 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.906+0000 7f4381200640 1 -- start start 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.907+0000 7f4381200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c159aa0 0x7f437c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.907+0000 7f4381200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f437c06e010 0x7f437c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f4381200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f437c0ccac0 0x7f437c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f4381200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f437c0ce5e0 con 0x7f437c0ccac0 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f4381200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f437c0ce830 con 0x7f437c06e010 2024-05-04T07:55:41.909 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f4381200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f437c0ceb10 con 0x7f437c159aa0 2024-05-04T07:55:41.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f437c0ccac0 0x7f437c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f437c0ccac0 0x7f437c15f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46250/0 (socket says 172.21.15.136:46250) 2024-05-04T07:55:41.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 -- 172.21.15.136:0/502459439 learned_addr learned my addr 172.21.15.136:0/502459439 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:41.910 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437b400640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c159aa0 0x7f437c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f4372a00640 1 --2- 172.21.15.136:0/502459439 >> v2:172.21.15.142:3300/0 conn(0x7f437c06e010 0x7f437c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 -- 172.21.15.136:0/502459439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c159aa0 msgr2=0x7f437c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c159aa0 0x7f437c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 -- 172.21.15.136:0/502459439 >> v2:172.21.15.142:3300/0 conn(0x7f437c06e010 msgr2=0x7f437c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 --2- 172.21.15.136:0/502459439 >> v2:172.21.15.142:3300/0 conn(0x7f437c06e010 0x7f437c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.911 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.908+0000 7f437be00640 1 -- 172.21.15.136:0/502459439 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c0cedf0 con 0x7f437c0ccac0 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f437be00640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c15f870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f437c06d650 tx=0x7f437402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25657e5bbf3e533 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f437aa00640 1 -- 172.21.15.136:0/502459439 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374036070 con 0x7f437c0ccac0 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f437aa00640 1 -- 172.21.15.136:0/502459439 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4374031600 con 0x7f437c0ccac0 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f437aa00640 1 -- 172.21.15.136:0/502459439 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43740319d0 con 0x7f437c0ccac0 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f4381200640 1 -- 172.21.15.136:0/502459439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 msgr2=0x7f437c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.910+0000 7f4381200640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c15f870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f437c06d650 tx=0x7f437402a610 comp rx=0 tx=0).stop 2024-05-04T07:55:41.912 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 -- 172.21.15.136:0/502459439 shutdown_connections 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c15f870 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 --2- 172.21.15.136:0/502459439 >> v2:172.21.15.142:3300/0 conn(0x7f437c06e010 0x7f437c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 --2- 172.21.15.136:0/502459439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c159aa0 0x7f437c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 -- 172.21.15.136:0/502459439 >> 172.21.15.136:0/502459439 conn(0x7f437c0cd490 msgr2=0x7f437c0cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 -- 172.21.15.136:0/502459439 shutdown_connections 2024-05-04T07:55:41.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.911+0000 7f4381200640 1 -- 172.21.15.136:0/502459439 wait complete. 2024-05-04T07:55:41.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.912+0000 7f4381200640 1 Processor -- start 2024-05-04T07:55:41.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 -- start start 2024-05-04T07:55:41.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c06e010 0x7f437c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.916 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f437c159aa0 0x7f437c072ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f437c1606b0 con 0x7f437c0ccac0 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f437c160530 con 0x7f437c159aa0 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.913+0000 7f4381200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f437c15fdb0 con 0x7f437c06e010 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46254/0 (socket says 172.21.15.136:46254) 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 -- 172.21.15.136:0/4260332907 learned_addr learned my addr 172.21.15.136:0/4260332907 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f437b400640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c06e010 0x7f437c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 -- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c06e010 msgr2=0x7f437c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c06e010 0x7f437c1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 -- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f437c159aa0 msgr2=0x7f437c072ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f437c159aa0 0x7f437c072ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.914+0000 7f4372a00640 1 -- 172.21.15.136:0/4260332907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c0b6190 con 0x7f437c0ccac0 2024-05-04T07:55:41.917 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4372a00640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f436400d800 tx=0x7f436400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43640096a0 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364019070 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364009a60 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c0b6470 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.915+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c151af0 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.916+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c069400 con 0x7f437c0ccac0 2024-05-04T07:55:41.918 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.917+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4364009c00 con 0x7f437c0ccac0 2024-05-04T07:55:41.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.918+0000 7f4373e00640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 0x7f4358078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:41.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.918+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f4364097c10 con 0x7f437c0ccac0 2024-05-04T07:55:41.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.919+0000 7f437b400640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 0x7f4358078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:41.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.919+0000 7f437b400640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 0x7f4358078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f436c006fd0 tx=0x7f436c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:41.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:41.923+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4364061360 con 0x7f437c0ccac0 2024-05-04T07:55:42.156 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.154+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f437c0b6640 con 0x7f437c0ccac0 2024-05-04T07:55:42.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.690+0000 7f4373e00640 1 -- 172.21.15.136:0/4260332907 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f4364060c60 con 0x7f437c0ccac0 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.693+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 msgr2=0x7f4358078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.693+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 0x7f4358078790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f436c006fd0 tx=0x7f436c008040 comp rx=0 tx=0).stop 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 msgr2=0x7f437c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f436400d800 tx=0x7f436400dcc0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 shutdown_connections 2024-05-04T07:55:42.695 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f43580762d0 0x7f4358078790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f437c159aa0 0x7f437c072ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f437c0ccac0 0x7f437c0b40f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 --2- 172.21.15.136:0/4260332907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f437c06e010 0x7f437c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 >> 172.21.15.136:0/4260332907 conn(0x7f437c0cd490 msgr2=0x7f437c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 shutdown_connections 2024-05-04T07:55:42.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.694+0000 7f4381200640 1 -- 172.21.15.136:0/4260332907 wait complete. 2024-05-04T07:55:42.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-04T07:55:42.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.918+0000 7f779ee00640 1 Processor -- start 2024-05-04T07:55:42.920 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.919+0000 7f779ee00640 1 -- start start 2024-05-04T07:55:42.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.920+0000 7f779ee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.920+0000 7f779ee00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 0x7f77980b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.920+0000 7f779ee00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980b7eb0 con 0x7f7798162a10 2024-05-04T07:55:42.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.920+0000 7f779ee00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f77980d06b0 con 0x7f77980b6010 2024-05-04T07:55:42.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.920+0000 7f779ee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f77980d0930 con 0x7f77980d3cb0 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f779ce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 0x7f77980b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f7797400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f779ce00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 0x7f77980b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.136:41440/0 (socket says 172.21.15.136:41440) 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f7797400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:53146/0 (socket says 172.21.15.136:53146) 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f779ce00640 1 -- 172.21.15.136:0/1351210840 learned_addr learned my addr 172.21.15.136:0/1351210840 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:42.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.921+0000 7f7797e00640 1 --1- 172.21.15.136:0/1351210840 >> v1:172.21.15.142:6789/0 conn(0x7f7798162a10 0x7f77980d35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.136:43024/0 (socket says 172.21.15.136:43024) 2024-05-04T07:55:42.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.922+0000 7f7797400640 1 -- 172.21.15.136:0/1351210840 >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 msgr2=0x7f77980b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:42.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.922+0000 7f7797400640 1 --2- 172.21.15.136:0/1351210840 >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 0x7f77980b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.922+0000 7f7797400640 1 -- 172.21.15.136:0/1351210840 >> v1:172.21.15.142:6789/0 conn(0x7f7798162a10 legacy=0x7f77980d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.922+0000 7f7797400640 1 -- 172.21.15.136:0/1351210840 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77980d0c10 con 0x7f77980d3cb0 2024-05-04T07:55:42.924 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.923+0000 7f7797400640 1 --2- 172.21.15.136:0/1351210840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77800097a0 tx=0x7f778002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b1ed97a2036f792 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:42.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.923+0000 7f7796a00640 1 -- 172.21.15.136:0/1351210840 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780037070 con 0x7f77980d3cb0 2024-05-04T07:55:42.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.923+0000 7f7796a00640 1 -- 172.21.15.136:0/1351210840 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778002ae50 con 0x7f77980d3cb0 2024-05-04T07:55:42.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.923+0000 7f7796a00640 1 -- 172.21.15.136:0/1351210840 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780032660 con 0x7f77980d3cb0 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 -- 172.21.15.136:0/1351210840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 msgr2=0x7f77980d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 --2- 172.21.15.136:0/1351210840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77800097a0 tx=0x7f778002a100 comp rx=0 tx=0).stop 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 -- 172.21.15.136:0/1351210840 shutdown_connections 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 --2- 172.21.15.136:0/1351210840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77980d3cb0 0x7f77980d2da0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 --2- 172.21.15.136:0/1351210840 >> v2:172.21.15.142:3300/0 conn(0x7f77980b6010 0x7f77980b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 -- 172.21.15.136:0/1351210840 >> 172.21.15.136:0/1351210840 conn(0x7f77980d4fc0 msgr2=0x7f77980d53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 -- 172.21.15.136:0/1351210840 shutdown_connections 2024-05-04T07:55:42.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.924+0000 7f779ee00640 1 -- 172.21.15.136:0/1351210840 wait complete. 2024-05-04T07:55:42.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.926+0000 7f779ee00640 1 Processor -- start 2024-05-04T07:55:42.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.926+0000 7f779ee00640 1 -- start start 2024-05-04T07:55:42.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77980d3cb0 0x7f77981522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7798162a10 0x7f77980ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7798162df0 con 0x7f77980b6010 2024-05-04T07:55:42.929 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f77980d0ef0 con 0x7f77980d3cb0 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f779ee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f77980b8b80 con 0x7f7798162a10 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f7797e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f7797e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46264/0 (socket says 172.21.15.136:46264) 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f7797e00640 1 -- 172.21.15.136:0/3280790207 learned_addr learned my addr 172.21.15.136:0/3280790207 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.927+0000 7f7797400640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77980d3cb0 0x7f77981522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f779ce00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7798162a10 0x7f77980ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 -- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7798162a10 msgr2=0x7f77980ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7798162a10 0x7f77980ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 -- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77980d3cb0 msgr2=0x7f77981522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77980d3cb0 0x7f77981522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 -- 172.21.15.136:0/3280790207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77981f5fa0 con 0x7f77980b6010 2024-05-04T07:55:42.930 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f7797e00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7a0 tx=0x7f778800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:42.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788017070 con 0x7f77980b6010 2024-05-04T07:55:42.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778800a640 con 0x7f77980b6010 2024-05-04T07:55:42.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778800aa30 con 0x7f77980b6010 2024-05-04T07:55:42.931 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.928+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77981f6280 con 0x7f77980b6010 2024-05-04T07:55:42.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.929+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981f6b20 con 0x7f77980b6010 2024-05-04T07:55:42.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.930+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77981f6670 con 0x7f77980b6010 2024-05-04T07:55:42.932 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.931+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f778801a070 con 0x7f77980b6010 2024-05-04T07:55:42.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.932+0000 7f778fe00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 0x7f7774078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:42.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.932+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6216+0+0 (secure 0 0 0) 0x7f7788096d80 con 0x7f77980b6010 2024-05-04T07:55:42.933 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.932+0000 7f7797400640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 0x7f7774078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:42.934 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.933+0000 7f7797400640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 0x7f7774078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7780034000 tx=0x7f778002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:42.938 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:42.937+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f778805fe80 con 0x7f77980b6010 2024-05-04T07:55:43.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:43.149+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77980694e0 con 0x7f77980b6010 2024-05-04T07:55:44.034 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.032+0000 7f778fe00640 1 -- 172.21.15.136:0/3280790207 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f7788064180 con 0x7f77980b6010 2024-05-04T07:55:44.034 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_metadata' removed 2024-05-04T07:55:44.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 msgr2=0x7f7774078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 0x7f7774078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7780034000 tx=0x7f778002e000 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 msgr2=0x7f77980b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7a0 tx=0x7f778800cc60 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 shutdown_connections 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f77740762d0 0x7f7774078790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7798162a10 0x7f77980ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77980d3cb0 0x7f77981522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 --2- 172.21.15.136:0/3280790207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77980b6010 0x7f77980b5390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.039 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 >> 172.21.15.136:0/3280790207 conn(0x7f77980d4fc0 msgr2=0x7f77980d53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:44.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.037+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 shutdown_connections 2024-05-04T07:55:44.040 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.039+0000 7f779ee00640 1 -- 172.21.15.136:0/3280790207 wait complete. 2024-05-04T07:55:44.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-04T07:55:44.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.262+0000 7f0513a00640 1 Processor -- start 2024-05-04T07:55:44.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.263+0000 7f0513a00640 1 -- start start 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0513a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f050c0d10e0 0x7f050c0709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0513a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c0d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0513a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c074180 con 0x7f050c06c3a0 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0513a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f050c073170 con 0x7f050c0d10e0 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0513a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f050c070f00 con 0x7f050c163770 2024-05-04T07:55:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0511000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f050c0d10e0 0x7f050c0709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0511000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f050c0d10e0 0x7f050c0709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47292/0 (socket says 172.21.15.136:47292) 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0511a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f050c06c3a0 0x7f050c06c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56864/0 (socket says 172.21.15.136:56864) 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.264+0000 7f0511000640 1 -- 172.21.15.136:0/136302388 learned_addr learned my addr 172.21.15.136:0/136302388 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.265+0000 7f0511000640 1 -- 172.21.15.136:0/136302388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 msgr2=0x7f050c0d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.265+0000 7f0511000640 1 --2- 172.21.15.136:0/136302388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c0d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.265+0000 7f0511000640 1 -- 172.21.15.136:0/136302388 >> v1:172.21.15.136:6789/0 conn(0x7f050c06c3a0 legacy=0x7f050c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.265+0000 7f0511000640 1 -- 172.21.15.136:0/136302388 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0d1a00 con 0x7f050c0d10e0 2024-05-04T07:55:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.266+0000 7f0511000640 1 --2- 172.21.15.136:0/136302388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c0709c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009870 tx=0x7f04fc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a7687044d92990 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.266+0000 7f050b400640 1 -- 172.21.15.136:0/136302388 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc037070 con 0x7f050c0d10e0 2024-05-04T07:55:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.266+0000 7f050b400640 1 -- 172.21.15.136:0/136302388 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04fc032440 con 0x7f050c0d10e0 2024-05-04T07:55:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.266+0000 7f050b400640 1 -- 172.21.15.136:0/136302388 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc032810 con 0x7f050c0d10e0 2024-05-04T07:55:44.268 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 -- 172.21.15.136:0/136302388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 msgr2=0x7f050c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 --2- 172.21.15.136:0/136302388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c0709c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009870 tx=0x7f04fc02a130 comp rx=0 tx=0).stop 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 -- 172.21.15.136:0/136302388 shutdown_connections 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 --2- 172.21.15.136:0/136302388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c0d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 --2- 172.21.15.136:0/136302388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c0709c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 -- 172.21.15.136:0/136302388 >> 172.21.15.136:0/136302388 conn(0x7f050c0d1d90 msgr2=0x7f050c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 -- 172.21.15.136:0/136302388 shutdown_connections 2024-05-04T07:55:44.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.267+0000 7f0513a00640 1 -- 172.21.15.136:0/136302388 wait complete. 2024-05-04T07:55:44.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.269+0000 7f0513a00640 1 Processor -- start 2024-05-04T07:55:44.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.269+0000 7f0513a00640 1 -- start start 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f050c06c3a0 0x7f050c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c1e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f050c073980 con 0x7f050c0d10e0 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f050c0736a0 con 0x7f050c06c3a0 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f0513a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f050c073c60 con 0x7f050c163770 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f050be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f050be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47302/0 (socket says 172.21.15.136:47302) 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.270+0000 7f050be00640 1 -- 172.21.15.136:0/2099859424 learned_addr learned my addr 172.21.15.136:0/2099859424 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 -- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 msgr2=0x7f050c1e9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c1e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 -- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f050c06c3a0 msgr2=0x7f050c14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f050c06c3a0 0x7f050c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 -- 172.21.15.136:0/2099859424 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c14dc70 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f050be00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04f400b4a0 tx=0x7f04f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4014070 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4010610 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4010a00 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.271+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c1f8880 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.272+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c1f8e40 con 0x7f050c0d10e0 2024-05-04T07:55:44.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.272+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c069b10 con 0x7f050c0d10e0 2024-05-04T07:55:44.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.274+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f04f4017070 con 0x7f050c0d10e0 2024-05-04T07:55:44.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.275+0000 7f0508c00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 0x7f04e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:44.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.275+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5778+0+0 (secure 0 0 0) 0x7f04f40970f0 con 0x7f050c0d10e0 2024-05-04T07:55:44.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.275+0000 7f0511000640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 0x7f04e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:44.277 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.276+0000 7f0511000640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 0x7f04e8078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:44.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.279+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04f4060960 con 0x7f050c0d10e0 2024-05-04T07:55:44.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:44.485+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f050c0d2450 con 0x7f050c0d10e0 2024-05-04T07:55:45.038 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.036+0000 7f0508c00640 1 -- 172.21.15.136:0/2099859424 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f04f4060260 con 0x7f050c0d10e0 2024-05-04T07:55:45.038 INFO:teuthology.orchestra.run.smithi136.stderr:pool 'cephfs_data' removed 2024-05-04T07:55:45.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 msgr2=0x7f04e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 0x7f04e8078790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f04fc034000 tx=0x7f04fc02c000 comp rx=0 tx=0).stop 2024-05-04T07:55:45.041 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 msgr2=0x7f050c160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04f400b4a0 tx=0x7f04f400b960 comp rx=0 tx=0).stop 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 shutdown_connections 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f04e80762d0 0x7f04e8078790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f050c163770 0x7f050c1e9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f050c0d10e0 0x7f050c160770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 --2- 172.21.15.136:0/2099859424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f050c06c3a0 0x7f050c14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.042 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.040+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 >> 172.21.15.136:0/2099859424 conn(0x7f050c0d1d90 msgr2=0x7f050c0b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:45.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.041+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 shutdown_connections 2024-05-04T07:55:45.044 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.043+0000 7f0513a00640 1 -- 172.21.15.136:0/2099859424 wait complete. 2024-05-04T07:55:45.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-04T07:55:45.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.270+0000 7f3a23800640 1 Processor -- start 2024-05-04T07:55:45.272 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.270+0000 7f3a23800640 1 -- start start 2024-05-04T07:55:45.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a23800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3a1c0720b0 0x7f3a1c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a23800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1c0cc090 con 0x7f3a1c15f2d0 2024-05-04T07:55:45.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a23800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1c0d0240 con 0x7f3a1c163540 2024-05-04T07:55:45.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a23800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3a1c0cbb10 con 0x7f3a1c0720b0 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a20e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3a1c15f2d0 0x7f3a1c162e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56872/0 (socket says 172.21.15.136:56872) 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a20e00640 1 -- 172.21.15.136:0/1223116777 learned_addr learned my addr 172.21.15.136:0/1223116777 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.272+0000 7f3a21800640 1 --2- 172.21.15.136:0/1223116777 >> v2:172.21.15.136:3300/0 conn(0x7f3a1c0720b0 0x7f3a1c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.273+0000 7f3a21800640 1 -- 172.21.15.136:0/1223116777 >> v1:172.21.15.142:6789/0 conn(0x7f3a1c163540 legacy=0x7f3a1c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.273+0000 7f3a21800640 1 -- 172.21.15.136:0/1223116777 >> v1:172.21.15.136:6789/0 conn(0x7f3a1c15f2d0 legacy=0x7f3a1c162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.273+0000 7f3a21800640 1 -- 172.21.15.136:0/1223116777 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c0d0520 con 0x7f3a1c0720b0 2024-05-04T07:55:45.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.274+0000 7f3a21800640 1 --2- 172.21.15.136:0/1223116777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c0cb5d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d90 tx=0x7f3a1402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd737fe8ddebf75 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.274+0000 7f3a1b400640 1 -- 172.21.15.136:0/1223116777 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007740 con 0x7f3a1c0720b0 2024-05-04T07:55:45.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.274+0000 7f3a1b400640 1 -- 172.21.15.136:0/1223116777 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a140078e0 con 0x7f3a1c0720b0 2024-05-04T07:55:45.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.274+0000 7f3a1b400640 1 -- 172.21.15.136:0/1223116777 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007cb0 con 0x7f3a1c0720b0 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 -- 172.21.15.136:0/1223116777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 msgr2=0x7f3a1c0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 --2- 172.21.15.136:0/1223116777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c0cb5d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009d90 tx=0x7f3a1402a660 comp rx=0 tx=0).stop 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 -- 172.21.15.136:0/1223116777 shutdown_connections 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 --2- 172.21.15.136:0/1223116777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c0cb5d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 -- 172.21.15.136:0/1223116777 >> 172.21.15.136:0/1223116777 conn(0x7f3a1c0d0c50 msgr2=0x7f3a1c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 -- 172.21.15.136:0/1223116777 shutdown_connections 2024-05-04T07:55:45.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.275+0000 7f3a23800640 1 -- 172.21.15.136:0/1223116777 wait complete. 2024-05-04T07:55:45.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.276+0000 7f3a23800640 1 Processor -- start 2024-05-04T07:55:45.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.277+0000 7f3a23800640 1 -- start start 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.277+0000 7f3a23800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.277+0000 7f3a23800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1c15f2d0 0x7f3a1c162360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.277+0000 7f3a23800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1c163540 0x7f3a1c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a23800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c163b30 con 0x7f3a1c0720b0 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a23800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0cc370 con 0x7f3a1c163540 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a23800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1c156000 con 0x7f3a1c15f2d0 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47310/0 (socket says 172.21.15.136:47310) 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 -- 172.21.15.136:0/3841335208 learned_addr learned my addr 172.21.15.136:0/3841335208 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a21800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1c163540 0x7f3a1c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.280 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 -- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1c15f2d0 msgr2=0x7f3a1c162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1c15f2d0 0x7f3a1c162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 -- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1c163540 msgr2=0x7f3a1c155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1c163540 0x7f3a1c155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.278+0000 7f3a20e00640 1 -- 172.21.15.136:0/3841335208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c1f5870 con 0x7f3a1c0720b0 2024-05-04T07:55:45.281 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a20e00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c420 tx=0x7f3a0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c017070 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c005d00 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c007310 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c1618c0 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.279+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c161b60 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.280+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c069470 con 0x7f3a1c0720b0 2024-05-04T07:55:45.282 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.281+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3a0c01a070 con 0x7f3a1c0720b0 2024-05-04T07:55:45.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.282+0000 7f3a18c00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 0x7f39fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.282+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f3a0c096850 con 0x7f3a1c0720b0 2024-05-04T07:55:45.284 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.282+0000 7f3a1be00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 0x7f39fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.283+0000 7f3a1be00640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 0x7f39fc0787c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.288 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.287+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3a0c060280 con 0x7f3a1c0720b0 2024-05-04T07:55:45.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:55:45.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:55:45.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.502+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3a1c163320 con 0x7f3a1c0720b0 2024-05-04T07:55:45.514 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.513+0000 7f3a18c00640 1 -- 172.21.15.136:0/3841335208 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f3a0c05fb80 con 0x7f3a1c0720b0 2024-05-04T07:55:45.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 msgr2=0x7f39fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 0x7f39fc0787c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08006bc0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 msgr2=0x7f3a1c1f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c420 tx=0x7f3a0c00c8e0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 shutdown_connections 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f39fc076300 0x7f39fc0787c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a1c163540 0x7f3a1c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a1c15f2d0 0x7f3a1c162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 --2- 172.21.15.136:0/3841335208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a1c0720b0 0x7f3a1c1f9b20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 >> 172.21.15.136:0/3841335208 conn(0x7f3a1c0d0c50 msgr2=0x7f3a1c06f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 shutdown_connections 2024-05-04T07:55:45.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.517+0000 7f3a23800640 1 -- 172.21.15.136:0/3841335208 wait complete. 2024-05-04T07:55:45.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-05-04T07:55:45.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.706+0000 7f805bc00640 1 Processor -- start 2024-05-04T07:55:45.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.707+0000 7f805bc00640 1 -- start start 2024-05-04T07:55:45.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f805bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f805415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f805bc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80540cc0a0 con 0x7f80540cffd0 2024-05-04T07:55:45.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f805bc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054160830 con 0x7f8054160340 2024-05-04T07:55:45.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f805bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f80540cf4f0 con 0x7f805415fa20 2024-05-04T07:55:45.710 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f8059c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f80540cffd0 0x7f80540cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56880/0 (socket says 172.21.15.136:56880) 2024-05-04T07:55:45.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f8059c00640 1 -- 172.21.15.136:0/3271369866 learned_addr learned my addr 172.21.15.136:0/3271369866 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:45.711 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.709+0000 7f8059200640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f805415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561572277 0 0) 0x7f80540cc0a0 con 0x7f80540cffd0 2024-05-04T07:55:45.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f803c005730 con 0x7f80540cffd0 2024-05-04T07:55:45.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 411849855 0 0) 0x7f803c005730 con 0x7f80540cffd0 2024-05-04T07:55:45.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 msgr2=0x7f805415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:45.712 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f805415fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 >> v1:172.21.15.142:6789/0 conn(0x7f8054160340 legacy=0x7f80540cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80540cf7d0 con 0x7f80540cffd0 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f804c001a70 con 0x7f80540cffd0 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 >> v1:172.21.15.136:6789/0 conn(0x7f80540cffd0 legacy=0x7f80540cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005cb0 0x7f803c0060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f803c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f803c007480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80540cf4f0 con 0x7f803c006a10 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f803c00dd90 con 0x7f803c005cb0 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.710+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f803c00df90 con 0x7f805415fa20 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f803c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8059200640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005cb0 0x7f803c0060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8059c00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f803c007480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 -- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 msgr2=0x7f803c007480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805415fa20 0x7f803c007480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 -- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005cb0 msgr2=0x7f803c0060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f803c005cb0 0x7f803c0060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.711+0000 7f8053e00640 1 -- 172.21.15.136:0/3271369866 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c005730 con 0x7f803c006a10 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.712+0000 7f8053e00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f803c006e90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8054160760 tx=0x7f803c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151895e0adcdcd55 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.712+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400013b0 con 0x7f803c006a10 2024-05-04T07:55:45.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.712+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80400052d0 con 0x7f803c006a10 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f8053400640 1 -- 172.21.15.136:0/3271369866 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804002aa70 con 0x7f803c006a10 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 -- 172.21.15.136:0/3271369866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 msgr2=0x7f803c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 --2- 172.21.15.136:0/3271369866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f803c006e90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8054160760 tx=0x7f803c007a40 comp rx=0 tx=0).stop 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f8059c00640 1 -- 172.21.15.136:0/3271369866 reap_dead start 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 -- 172.21.15.136:0/3271369866 shutdown_connections 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 -- 172.21.15.136:0/3271369866 >> 172.21.15.136:0/3271369866 conn(0x7f80540d0c30 msgr2=0x7f80540d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 -- 172.21.15.136:0/3271369866 shutdown_connections 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.713+0000 7f805bc00640 1 -- 172.21.15.136:0/3271369866 wait complete. 2024-05-04T07:55:45.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.715+0000 7f805bc00640 1 Processor -- start 2024-05-04T07:55:45.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.715+0000 7f805bc00640 1 -- start start 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 0x7f80540aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805413eeb0 0x7f805413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8054144f70 con 0x7f803c006a10 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80540cf1c0 con 0x7f805413eeb0 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.716+0000 7f805bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f80541457d0 con 0x7f80540ae870 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47330/0 (socket says 172.21.15.136:47330) 2024-05-04T07:55:45.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 -- 172.21.15.136:0/133142811 learned_addr learned my addr 172.21.15.136:0/133142811 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059c00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805413eeb0 0x7f805413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8053e00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 0x7f80540aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 -- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 msgr2=0x7f80540aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 0x7f80540aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 -- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805413eeb0 msgr2=0x7f805413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805413eeb0 0x7f805413f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 -- 172.21.15.136:0/133142811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80540af330 con 0x7f803c006a10 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8053e00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 0x7f80540aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.717+0000 7f8059200640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8048011600 tx=0x7f8048011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.718+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804800f920 con 0x7f803c006a10 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.718+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804800fac0 con 0x7f803c006a10 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.718+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804800fe70 con 0x7f803c006a10 2024-05-04T07:55:45.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.718+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80540af610 con 0x7f803c006a10 2024-05-04T07:55:45.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.718+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80540afbd0 con 0x7f803c006a10 2024-05-04T07:55:45.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.719+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8054069400 con 0x7f803c006a10 2024-05-04T07:55:45.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.720+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8048015460 con 0x7f803c006a10 2024-05-04T07:55:45.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.721+0000 7f8050c00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 0x7f8034078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:45.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.721+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f8048097e40 con 0x7f803c006a10 2024-05-04T07:55:45.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.722+0000 7f8053e00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 0x7f8034078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:45.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.722+0000 7f8053e00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 0x7f8034078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8040032000 tx=0x7f804002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:45.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:45.727+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8048019030 con 0x7f803c006a10 2024-05-04T07:55:46.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.005+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f8054072740 con 0x7f803c006a10 2024-05-04T07:55:46.064 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.063+0000 7f8050c00640 1 -- 172.21.15.136:0/133142811 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v222) ==== 120+0+0 (secure 0 0 0) 0x7f8048061900 con 0x7f803c006a10 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 msgr2=0x7f8034078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 0x7f8034078790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8040032000 tx=0x7f804002e000 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 msgr2=0x7f805415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8048011600 tx=0x7f8048011ac0 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 shutdown_connections 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f80340762d0 0x7f8034078790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805413eeb0 0x7f805413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80540ae870 0x7f80540aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 --2- 172.21.15.136:0/133142811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803c006a10 0x7f805415b6e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 >> 172.21.15.136:0/133142811 conn(0x7f80540d0c30 msgr2=0x7f80540c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 shutdown_connections 2024-05-04T07:55:46.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:46.067+0000 7f805bc00640 1 -- 172.21.15.136:0/133142811 wait complete. 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner: 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner:Ran 1 test in 271.676s 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner: 2024-05-04T07:55:46.087 INFO:tasks.cephfs_test_runner:OK 2024-05-04T07:55:46.088 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-04T07:55:46.099 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-04T07:55:46.113 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-04T07:55:46.113 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:55:46.113 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:46.166 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-04T07:55:46.166 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-04T07:55:46.166 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:46.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-04T07:55:46.218 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:55:46.218 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:46.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-04T07:55:46.265 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-05-04T07:55:46.265 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T07:55:46.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-04T07:55:46.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.356 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:55:46.415 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-04T07:55:46.416 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-04T07:55:46.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T07:55:46.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-04T07:55:46.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.573 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-05-04T07:55:46.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.679 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-05-04T07:55:46.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.721 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-05-04T07:55:46.837 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-05-04T07:55:46.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:55:46.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.841 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:55:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-04T07:55:46.893 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-04T07:55:46.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-04T07:55:46.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:46.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-04T07:55:47.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:47.029 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-05-04T07:55:47.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:47.149 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-05-04T07:55:47.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T07:55:47.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-05-04T07:55:47.298 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-05-04T07:55:47.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:55:47.302 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-04T07:55:47.311 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T07:55:47.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:55:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.522+0000 7f380a800640 1 Processor -- start 2024-05-04T07:55:47.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.523+0000 7f380a800640 1 -- start start 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.524+0000 7f380a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f380415fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.524+0000 7f380a800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3804160340 0x7f38040cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.524+0000 7f380a800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3804160830 con 0x7f38040cffd0 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.524+0000 7f380a800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f38040cf4f0 con 0x7f3804160340 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.524+0000 7f380a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f38040cf7d0 con 0x7f380415fa20 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f3803e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f38040cffd0 0x7f38040cb7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56886/0 (socket says 172.21.15.136:56886) 2024-05-04T07:55:47.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f3803e00640 1 -- 172.21.15.136:0/3053335903 learned_addr learned my addr 172.21.15.136:0/3053335903 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307398538 0 0) 0x7f3804160830 con 0x7f38040cffd0 2024-05-04T07:55:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e8003520 con 0x7f38040cffd0 2024-05-04T07:55:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f3803400640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f380415fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.525+0000 7f37faa00640 1 --2- 172.21.15.136:0/3053335903 >> v2:172.21.15.142:3300/0 conn(0x7f3804160340 0x7f38040cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1547883761 0 0) 0x7f37e8003520 con 0x7f38040cffd0 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 msgr2=0x7f380415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f380415fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 >> v2:172.21.15.142:3300/0 conn(0x7f3804160340 msgr2=0x7f38040cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 --2- 172.21.15.136:0/3053335903 >> v2:172.21.15.142:3300/0 conn(0x7f3804160340 0x7f38040cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38040cfab0 con 0x7f38040cffd0 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f37fc001a70 con 0x7f38040cffd0 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 >> v1:172.21.15.136:6789/0 conn(0x7f38040cffd0 legacy=0x7f38040cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e8003a70 0x7f37e8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f37e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f37e8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f38040cf4f0 con 0x7f37e8004800 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f38040cf7d0 con 0x7f37e8003a70 2024-05-04T07:55:47.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f37e800bb70 con 0x7f380415fa20 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f37faa00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f37e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3803e00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f37e8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.526+0000 7f3803400640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e8003a70 0x7f37e8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.527+0000 7f37faa00640 1 -- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 msgr2=0x7f37e8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.527+0000 7f37faa00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f380415fa20 0x7f37e8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.527+0000 7f37faa00640 1 -- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e8003a70 msgr2=0x7f37e8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.527+0000 7f37faa00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37e8003a70 0x7f37e8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.529 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.527+0000 7f37faa00640 1 -- 172.21.15.136:0/3053335903 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e8003520 con 0x7f37e8004800 2024-05-04T07:55:47.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.528+0000 7f37faa00640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f37e8004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ba00 tx=0x7f37e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1a3a8f978f17a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.528+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec030070 con 0x7f37e8004800 2024-05-04T07:55:47.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.528+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec02ade0 con 0x7f37e8004800 2024-05-04T07:55:47.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.528+0000 7f3802a00640 1 -- 172.21.15.136:0/3053335903 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00b600 con 0x7f37e8004800 2024-05-04T07:55:47.530 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 -- 172.21.15.136:0/3053335903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 msgr2=0x7f37e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 --2- 172.21.15.136:0/3053335903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f37e8004c80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00ba00 tx=0x7f37e8005830 comp rx=0 tx=0).stop 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f3803e00640 1 -- 172.21.15.136:0/3053335903 reap_dead start 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 -- 172.21.15.136:0/3053335903 shutdown_connections 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 -- 172.21.15.136:0/3053335903 >> 172.21.15.136:0/3053335903 conn(0x7f38040d0c30 msgr2=0x7f38040d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 -- 172.21.15.136:0/3053335903 shutdown_connections 2024-05-04T07:55:47.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.529+0000 7f380a800640 1 -- 172.21.15.136:0/3053335903 wait complete. 2024-05-04T07:55:47.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.531+0000 7f380a800640 1 Processor -- start 2024-05-04T07:55:47.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.531+0000 7f380a800640 1 -- start start 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3804143290 0x7f38041436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3804150190 0x7f3804150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f38040cbed0 con 0x7f37e8004800 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3804144f70 con 0x7f3804143290 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.532+0000 7f380a800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f38040cc050 con 0x7f3804150190 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47354/0 (socket says 172.21.15.136:47354) 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 -- 172.21.15.136:0/381185246 learned_addr learned my addr 172.21.15.136:0/381185246 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803e00640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3804150190 0x7f3804150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f37faa00640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3804143290 0x7f38041436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 -- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3804150190 msgr2=0x7f3804150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3804150190 0x7f3804150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 -- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3804143290 msgr2=0x7f38041436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3804143290 0x7f38041436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 -- 172.21.15.136:0/381185246 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3804150b50 con 0x7f37e8004800 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.533+0000 7f3803400640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f37f400f580 tx=0x7f37f400fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.534+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4019020 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.534+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4014870 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.534+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4014c60 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.534+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380415f070 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.534+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3804144160 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.535+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3804069400 con 0x7f37e8004800 2024-05-04T07:55:47.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.536+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37f401c020 con 0x7f37e8004800 2024-05-04T07:55:47.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.538+0000 7f37fbe00640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 0x7f37e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.538+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f37f4097cf0 con 0x7f37e8004800 2024-05-04T07:55:47.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.538+0000 7f37faa00640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 0x7f37e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.539+0000 7f37faa00640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 0x7f37e0078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3804160760 tx=0x7f37ec030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.543+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37f4023020 con 0x7f37e8004800 2024-05-04T07:55:47.743 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.742+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3804143c30 con 0x7f37e00762d0 2024-05-04T07:55:47.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.743+0000 7f37fbe00640 1 -- 172.21.15.136:0/381185246 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7f3804143c30 con 0x7f37e00762d0 2024-05-04T07:55:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:47.745 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 msgr2=0x7f37e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 0x7f37e0078790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3804160760 tx=0x7f37ec030000 comp rx=0 tx=0).stop 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 msgr2=0x7f38041413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f37f400f580 tx=0x7f37f400fa40 comp rx=0 tx=0).stop 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 shutdown_connections 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f37e00762d0 0x7f37e0078790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3804150190 0x7f3804150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3804143290 0x7f38041436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 --2- 172.21.15.136:0/381185246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f37e8004800 0x7f38041413c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.746+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 >> 172.21.15.136:0/381185246 conn(0x7f38040d0c30 msgr2=0x7f38040cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:47.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.747+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 shutdown_connections 2024-05-04T07:55:47.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.747+0000 7f380a800640 1 -- 172.21.15.136:0/381185246 wait complete. 2024-05-04T07:55:47.764 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-05-04T07:55:47.370481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222412,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752308,"statfs":{"total":773094113280,"available":772866363392,"internally_reserved":0,"allocated":6402048,"data_stored":4143745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-611548,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-6,"num_write":-114,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-05-04T07:55:44.265854+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:55:44.265854+0000","last_peered":"2024-05-04T07:55:44.265854+0000","last_clean":"2024-05-04T07:55:44.265854+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:55:44.265854+0000","last_undegraded":"2024-05-04T07:55:44.265854+0000","last_fullsized":"2024-05-04T07:55:44.265854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28688,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343152,"statfs":{"total":96636764160,"available":96607387648,"internally_reserved":0,"allocated":1708032,"data_stored":1417295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":215208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":831840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":805498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:55:47.765 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:55:47.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.949+0000 7fcff4600640 1 Processor -- start 2024-05-04T07:55:47.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.949+0000 7fcff4600640 1 -- start start 2024-05-04T07:55:47.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff4600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff4600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcfec0c5ab0 0x7fcfec0c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff4600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfec146900 con 0x7fcfec13ff40 2024-05-04T07:55:47.951 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff4600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcfec140320 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff4600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcfec072890 con 0x7fcfec071ef0 2024-05-04T07:55:47.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff1200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec072350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:41910/0 (socket says 172.21.15.136:41910) 2024-05-04T07:55:47.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff2600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcfec0c5ab0 0x7fcfec0c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.952 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.951+0000 7fcff1200640 1 -- 172.21.15.136:0/485641122 learned_addr learned my addr 172.21.15.136:0/485641122 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:47.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.952+0000 7fcff2600640 1 -- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 msgr2=0x7fcfec072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.952+0000 7fcff2600640 1 --2- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.952+0000 7fcff2600640 1 -- 172.21.15.136:0/485641122 >> v1:172.21.15.142:6789/0 conn(0x7fcfec13ff40 legacy=0x7fcfec145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:47.953 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.952+0000 7fcff2600640 1 -- 172.21.15.136:0/485641122 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec15d7f0 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.954+0000 7fcff2600640 1 --2- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec0c5f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009d90 tx=0x7fcfe402a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10db95cd3d21c8d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.954+0000 7fcfebe00640 1 -- 172.21.15.136:0/485641122 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4007740 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcfebe00640 1 -- 172.21.15.136:0/485641122 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe40078e0 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcfebe00640 1 -- 172.21.15.136:0/485641122 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4007cb0 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 -- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec0c5ab0 msgr2=0x7fcfec0c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 --2- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec0c5f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009d90 tx=0x7fcfe402a5b0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 -- 172.21.15.136:0/485641122 shutdown_connections 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 --2- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 --2- 172.21.15.136:0/485641122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec0c5f40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.955+0000 7fcff4600640 1 -- 172.21.15.136:0/485641122 >> 172.21.15.136:0/485641122 conn(0x7fcfec0d0c30 msgr2=0x7fcfec0d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:47.956 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.956+0000 7fcff4600640 1 -- 172.21.15.136:0/485641122 shutdown_connections 2024-05-04T07:55:47.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.956+0000 7fcff4600640 1 -- 172.21.15.136:0/485641122 wait complete. 2024-05-04T07:55:47.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.957+0000 7fcff4600640 1 Processor -- start 2024-05-04T07:55:47.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.957+0000 7fcff4600640 1 -- start start 2024-05-04T07:55:47.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec13ff40 0x7fcfec137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec161910 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec15de40 con 0x7fcfec13ff40 2024-05-04T07:55:47.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff4600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcfec15d4a0 con 0x7fcfec071ef0 2024-05-04T07:55:47.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.958+0000 7fcff1200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47362/0 (socket says 172.21.15.136:47362) 2024-05-04T07:55:47.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 -- 172.21.15.136:0/1600053157 learned_addr learned my addr 172.21.15.136:0/1600053157 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:47.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff2600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec13ff40 0x7fcfec137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 -- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 msgr2=0x7fcfec15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1c00640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 -- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec13ff40 msgr2=0x7fcfec137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec13ff40 0x7fcfec137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 -- 172.21.15.136:0/1600053157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec0b5c00 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcff1200640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800e8b0 tx=0x7fcfd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.959+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8017070 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.961 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.960+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd800c940 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.960+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800cd10 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.960+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec0b5ee0 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.960+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec15a670 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.961+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec069400 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.962 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.962+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcfd801a070 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.963+0000 7fcfe9600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 0x7fcfcc07cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:47.963 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.963+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fcfd8097840 con 0x7fcfec0c5ab0 2024-05-04T07:55:47.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.963+0000 7fcff1c00640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 0x7fcfcc07cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:47.964 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.964+0000 7fcff1c00640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 0x7fcfcc07cba0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006fd0 tx=0x7fcfe0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:47.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:47.967+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcfd8061270 con 0x7fcfec0c5ab0 2024-05-04T07:55:48.157 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.156+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfec0b59b0 con 0x7fcfcc07a6e0 2024-05-04T07:55:48.158 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.157+0000 7fcfe9600640 1 -- 172.21.15.136:0/1600053157 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7fcfec0b59b0 con 0x7fcfcc07a6e0 2024-05-04T07:55:48.158 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:48.159 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 msgr2=0x7fcfcc07cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 0x7fcfcc07cba0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006fd0 tx=0x7fcfe0008040 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 msgr2=0x7fcfec136b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800e8b0 tx=0x7fcfd800ed70 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 shutdown_connections 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fcfcc07a6e0 0x7fcfcc07cba0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfec13ff40 0x7fcfec137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfec0c5ab0 0x7fcfec136b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 --2- 172.21.15.136:0/1600053157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfec071ef0 0x7fcfec15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.161 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 >> 172.21.15.136:0/1600053157 conn(0x7fcfec0d0c30 msgr2=0x7fcfec0c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:48.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 shutdown_connections 2024-05-04T07:55:48.162 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.160+0000 7fcff4600640 1 -- 172.21.15.136:0/1600053157 wait complete. 2024-05-04T07:55:48.178 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-05-04T07:55:47.370481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222412,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752308,"statfs":{"total":773094113280,"available":772866363392,"internally_reserved":0,"allocated":6402048,"data_stored":4143745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-611548,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-6,"num_write":-114,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-05-04T07:55:44.265854+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:55:44.265854+0000","last_peered":"2024-05-04T07:55:44.265854+0000","last_clean":"2024-05-04T07:55:44.265854+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:55:44.265854+0000","last_undegraded":"2024-05-04T07:55:44.265854+0000","last_fullsized":"2024-05-04T07:55:44.265854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28688,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343152,"statfs":{"total":96636764160,"available":96607387648,"internally_reserved":0,"allocated":1708032,"data_stored":1417295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":215208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":831840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":805498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:55:48.178 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T07:55:48.179 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:55:48.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.370+0000 7f638a400640 1 Processor -- start 2024-05-04T07:55:48.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.371+0000 7f638a400640 1 -- start start 2024-05-04T07:55:48.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.372+0000 7f638a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.372+0000 7f638a400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f638406e5b0 0x7f63840d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.372+0000 7f638a400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638406d760 con 0x7f638415f330 2024-05-04T07:55:48.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.372+0000 7f638a400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f63840cd930 con 0x7f638406e5b0 2024-05-04T07:55:48.373 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.372+0000 7f638a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f638406da40 con 0x7f63840d38f0 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6383e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f638406e5b0 0x7f63840d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:41924/0 (socket says 172.21.15.136:41924) 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 -- 172.21.15.136:0/730166575 learned_addr learned my addr 172.21.15.136:0/730166575 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 -- 172.21.15.136:0/730166575 >> v2:172.21.15.142:3300/0 conn(0x7f638406e5b0 msgr2=0x7f63840d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 --2- 172.21.15.136:0/730166575 >> v2:172.21.15.142:3300/0 conn(0x7f638406e5b0 0x7f63840d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 -- 172.21.15.136:0/730166575 >> v1:172.21.15.142:6789/0 conn(0x7f638415f330 legacy=0x7f638406dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.373+0000 7f6382a00640 1 -- 172.21.15.136:0/730166575 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840cd5c0 con 0x7f63840d38f0 2024-05-04T07:55:48.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.375+0000 7f6382a00640 1 --2- 172.21.15.136:0/730166575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f636c009870 tx=0x7f636c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a084374a0ea764e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.375+0000 7f6382000640 1 -- 172.21.15.136:0/730166575 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c037070 con 0x7f63840d38f0 2024-05-04T07:55:48.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.375+0000 7f6382000640 1 -- 172.21.15.136:0/730166575 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c032440 con 0x7f63840d38f0 2024-05-04T07:55:48.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.375+0000 7f6382000640 1 -- 172.21.15.136:0/730166575 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c032810 con 0x7f63840d38f0 2024-05-04T07:55:48.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 -- 172.21.15.136:0/730166575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 msgr2=0x7f63840d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 --2- 172.21.15.136:0/730166575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f636c009870 tx=0x7f636c02a1c0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 -- 172.21.15.136:0/730166575 shutdown_connections 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 --2- 172.21.15.136:0/730166575 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840d1100 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 --2- 172.21.15.136:0/730166575 >> v2:172.21.15.142:3300/0 conn(0x7f638406e5b0 0x7f63840d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 -- 172.21.15.136:0/730166575 >> 172.21.15.136:0/730166575 conn(0x7f63840d2dd0 msgr2=0x7f63840d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 -- 172.21.15.136:0/730166575 shutdown_connections 2024-05-04T07:55:48.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.376+0000 7f638a400640 1 -- 172.21.15.136:0/730166575 wait complete. 2024-05-04T07:55:48.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.378+0000 7f638a400640 1 Processor -- start 2024-05-04T07:55:48.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.378+0000 7f638a400640 1 -- start start 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f638406e5b0 0x7f638415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f63840d0710 con 0x7f638415f330 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f63840d0590 con 0x7f638406e5b0 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f638a400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f63840cedd0 con 0x7f63840d38f0 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47366/0 (socket says 172.21.15.136:47366) 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 -- 172.21.15.136:0/3538426530 learned_addr learned my addr 172.21.15.136:0/3538426530 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f638406e5b0 0x7f638415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6382a00640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 -- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 msgr2=0x7f63840cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 -- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f638406e5b0 msgr2=0x7f638415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f638406e5b0 0x7f638415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.379+0000 7f6383e00640 1 -- 172.21.15.136:0/3538426530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840ca950 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f6383e00640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f637c009dd0 tx=0x7f637c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c018020 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637c014480 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c014870 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63840cabc0 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.380+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63840cb180 con 0x7f638415f330 2024-05-04T07:55:48.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.381+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6384069400 con 0x7f638415f330 2024-05-04T07:55:48.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.382+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f637c005d10 con 0x7f638415f330 2024-05-04T07:55:48.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.383+0000 7f637b400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 0x7f6360078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.383+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f637c0980a0 con 0x7f638415f330 2024-05-04T07:55:48.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.384+0000 7f6383400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 0x7f6360078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.384+0000 7f6383400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 0x7f6360078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63740015e0 tx=0x7f6374009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.388+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f637c022070 con 0x7f638415f330 2024-05-04T07:55:48.573 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.573+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63840cfd40 con 0x7f63600762d0 2024-05-04T07:55:48.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.575+0000 7f637b400640 1 -- 172.21.15.136:0/3538426530 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7f63840cfd40 con 0x7f63600762d0 2024-05-04T07:55:48.576 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:48.576 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:55:48.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.577+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 msgr2=0x7f6360078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.578 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.577+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 0x7f6360078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f63740015e0 tx=0x7f6374009040 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 msgr2=0x7f6384161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f637c009dd0 tx=0x7f637c00c490 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 shutdown_connections 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f63600762d0 0x7f6360078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f638415f330 0x7f6384161410 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63840d38f0 0x7f63840cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 --2- 172.21.15.136:0/3538426530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f638406e5b0 0x7f638415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 >> 172.21.15.136:0/3538426530 conn(0x7f63840d2dd0 msgr2=0x7f63840d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 shutdown_connections 2024-05-04T07:55:48.579 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.578+0000 7f638a400640 1 -- 172.21.15.136:0/3538426530 wait complete. 2024-05-04T07:55:48.597 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-05-04T07:55:47.370481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222412,"kb_used_data":6252,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752308,"statfs":{"total":773094113280,"available":772866363392,"internally_reserved":0,"allocated":6402048,"data_stored":4143745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-611548,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-6,"num_write":-114,"num_write_kb":-656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001748"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":156,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-05-04T07:55:44.265854+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:55:44.265854+0000","last_peered":"2024-05-04T07:55:44.265854+0000","last_clean":"2024-05-04T07:55:44.265854+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:55:44.265854+0000","last_undegraded":"2024-05-04T07:55:44.265854+0000","last_fullsized":"2024-05-04T07:55:44.265854+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28688,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343152,"statfs":{"total":96636764160,"available":96607387648,"internally_reserved":0,"allocated":1708032,"data_stored":1417295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":215208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1122304,"data_stored":831840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":221520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":215186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1085440,"data_stored":805498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:55:48.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T07:55:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.792+0000 7f95ebc00640 1 Processor -- start 2024-05-04T07:55:48.793 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.792+0000 7f95ebc00640 1 -- start start 2024-05-04T07:55:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.793+0000 7f95ebc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 0x7f95e40ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95ebc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95ebc00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e40d24d0 con 0x7f95e40cf7b0 2024-05-04T07:55:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95ebc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f95e40b24b0 con 0x7f95e415f650 2024-05-04T07:55:48.794 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95ebc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95e406dc80 con 0x7f95e40b1f60 2024-05-04T07:55:48.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95e9c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95e3e00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 0x7f95e40ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95e9c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.136:41934/0 (socket says 172.21.15.136:41934) 2024-05-04T07:55:48.795 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.794+0000 7f95e9c00640 1 -- 172.21.15.136:0/1246955839 learned_addr learned my addr 172.21.15.136:0/1246955839 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:48.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.795+0000 7f95e9c00640 1 -- 172.21.15.136:0/1246955839 >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 msgr2=0x7f95e40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:48.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.795+0000 7f95e9c00640 1 --2- 172.21.15.136:0/1246955839 >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 0x7f95e40ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.795+0000 7f95e9c00640 1 -- 172.21.15.136:0/1246955839 >> v1:172.21.15.142:6789/0 conn(0x7f95e40cf7b0 legacy=0x7f95e40cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.795+0000 7f95e9c00640 1 -- 172.21.15.136:0/1246955839 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e406d9a0 con 0x7f95e40b1f60 2024-05-04T07:55:48.796 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.795+0000 7f95e3e00640 1 --2- 172.21.15.136:0/1246955839 >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 0x7f95e40ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T07:55:48.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.797+0000 7f95e9c00640 1 --2- 172.21.15.136:0/1246955839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef979eabd80f0c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.797+0000 7f95e3400640 1 -- 172.21.15.136:0/1246955839 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc036070 con 0x7f95e40b1f60 2024-05-04T07:55:48.797 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.797+0000 7f95e3400640 1 -- 172.21.15.136:0/1246955839 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc031600 con 0x7f95e40b1f60 2024-05-04T07:55:48.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.797+0000 7f95e3400640 1 -- 172.21.15.136:0/1246955839 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0319d0 con 0x7f95e40b1f60 2024-05-04T07:55:48.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 -- 172.21.15.136:0/1246955839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 msgr2=0x7f95e40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.798 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 --2- 172.21.15.136:0/1246955839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009e50 tx=0x7f95dc02a710 comp rx=0 tx=0).stop 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 -- 172.21.15.136:0/1246955839 shutdown_connections 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 --2- 172.21.15.136:0/1246955839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40b1f60 0x7f95e40ce5e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 --2- 172.21.15.136:0/1246955839 >> v2:172.21.15.142:3300/0 conn(0x7f95e415f650 0x7f95e40ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 -- 172.21.15.136:0/1246955839 >> 172.21.15.136:0/1246955839 conn(0x7f95e40d2dd0 msgr2=0x7f95e40d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 -- 172.21.15.136:0/1246955839 shutdown_connections 2024-05-04T07:55:48.799 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.798+0000 7f95ebc00640 1 -- 172.21.15.136:0/1246955839 wait complete. 2024-05-04T07:55:48.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.800+0000 7f95ebc00640 1 Processor -- start 2024-05-04T07:55:48.801 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.800+0000 7f95ebc00640 1 -- start start 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e40b1f60 0x7f95e40c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40cf7b0 0x7f95e41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40cd8a0 con 0x7f95e415f650 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95e406d750 con 0x7f95e40b1f60 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95ebc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f95e40cdb80 con 0x7f95e40cf7b0 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e9c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e9c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47372/0 (socket says 172.21.15.136:47372) 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e9c00640 1 -- 172.21.15.136:0/3121301312 learned_addr learned my addr 172.21.15.136:0/3121301312 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e9200640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e40b1f60 0x7f95e40c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.803 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e3e00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40cf7b0 0x7f95e41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.802+0000 7f95e9c00640 1 -- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40cf7b0 msgr2=0x7f95e41521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e9c00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40cf7b0 0x7f95e41521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e9c00640 1 -- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e40b1f60 msgr2=0x7f95e40c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:48.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e9c00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e40b1f60 0x7f95e40c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:48.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e9c00640 1 -- 172.21.15.136:0/3121301312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40c8930 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e9c00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009f70 tx=0x7f95dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc041030 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc031400 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc036040 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e40c8c10 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.803+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e40c91d0 con 0x7f95e415f650 2024-05-04T07:55:48.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.804+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e406e080 con 0x7f95e415f650 2024-05-04T07:55:48.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.806+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f95dc044070 con 0x7f95e415f650 2024-05-04T07:55:48.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.807+0000 7f95e0c00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 0x7f95c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:48.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.807+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f95dc0b7d10 con 0x7f95e415f650 2024-05-04T07:55:48.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.807+0000 7f95e9200640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 0x7f95c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:48.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.808+0000 7f95e9200640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 0x7f95c4078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001680 tx=0x7f95d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:48.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:48.811+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f95dc0bd020 con 0x7f95e415f650 2024-05-04T07:55:49.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.018+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95e4069400 con 0x7f95e415f650 2024-05-04T07:55:49.019 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.019+0000 7f95e0c00640 1 -- 172.21.15.136:0/3121301312 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+13355 (secure 0 0 0) 0x7f95dc04b070 con 0x7f95e415f650 2024-05-04T07:55:49.020 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:49.020 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":44,"fsid":"9ecc10c5-f8dd-4dd0-88f7-548a507c724d","created":"2024-05-04T07:50:01.969350+0000","modified":"2024-05-04T07:55:45.034047+0000","last_up_change":"2024-05-04T07:50:14.092112+0000","last_in_change":"2024-05-04T07:50:05.356694+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T07:50:15.303015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1995056f-f975-4719-a17e-b363ac8c48ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6803","nonce":3794668031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6807","nonce":3794668031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6813","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6815","nonce":3794668031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":3794668031},{"type":"v1","addr":"172.21.15.136:6811","nonce":3794668031}]},"public_addr":"172.21.15.136:6803/3794668031","cluster_addr":"172.21.15.136:6807/3794668031","heartbeat_back_addr":"172.21.15.136:6815/3794668031","heartbeat_front_addr":"172.21.15.136:6811/3794668031","state":["exists","up"]},{"osd":1,"uuid":"5de40d6d-0279-441d-a67a-18bd62fae91c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6802","nonce":1755931055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6806","nonce":1755931055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6814","nonce":1755931055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1755931055},{"type":"v1","addr":"172.21.15.136:6810","nonce":1755931055}]},"public_addr":"172.21.15.136:6802/1755931055","cluster_addr":"172.21.15.136:6806/1755931055","heartbeat_back_addr":"172.21.15.136:6814/1755931055","heartbeat_front_addr":"172.21.15.136:6810/1755931055","state":["exists","up"]},{"osd":2,"uuid":"108de325-41aa-4eb3-844d-df06c2eabe3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6825","nonce":2411296812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6827","nonce":2411296812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6831","nonce":2411296812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2411296812},{"type":"v1","addr":"172.21.15.136:6829","nonce":2411296812}]},"public_addr":"172.21.15.136:6825/2411296812","cluster_addr":"172.21.15.136:6827/2411296812","heartbeat_back_addr":"172.21.15.136:6831/2411296812","heartbeat_front_addr":"172.21.15.136:6829/2411296812","state":["exists","up"]},{"osd":3,"uuid":"e2f45b44-f8c2-45cc-92b6-92a394de8264","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6817","nonce":2323540888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6819","nonce":2323540888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6823","nonce":2323540888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2323540888},{"type":"v1","addr":"172.21.15.136:6821","nonce":2323540888}]},"public_addr":"172.21.15.136:6817/2323540888","cluster_addr":"172.21.15.136:6819/2323540888","heartbeat_back_addr":"172.21.15.136:6823/2323540888","heartbeat_front_addr":"172.21.15.136:6821/2323540888","state":["exists","up"]},{"osd":4,"uuid":"b4e9985e-b481-49b4-af5a-13a16824273a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6809","nonce":2527007446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6811","nonce":2527007446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6815","nonce":2527007446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2527007446},{"type":"v1","addr":"172.21.15.142:6813","nonce":2527007446}]},"public_addr":"172.21.15.142:6809/2527007446","cluster_addr":"172.21.15.142:6811/2527007446","heartbeat_back_addr":"172.21.15.142:6815/2527007446","heartbeat_front_addr":"172.21.15.142:6813/2527007446","state":["exists","up"]},{"osd":5,"uuid":"b807b4ca-2c3c-467a-aced-d47ebe2c0854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6801","nonce":2745467739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6803","nonce":2745467739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6807","nonce":2745467739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":2745467739},{"type":"v1","addr":"172.21.15.142:6805","nonce":2745467739}]},"public_addr":"172.21.15.142:6801/2745467739","cluster_addr":"172.21.15.142:6803/2745467739","heartbeat_back_addr":"172.21.15.142:6807/2745467739","heartbeat_front_addr":"172.21.15.142:6805/2745467739","state":["exists","up"]},{"osd":6,"uuid":"f8ffaa6b-f025-450e-b0a9-af514bec2462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6817","nonce":3988723110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6819","nonce":3988723110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6823","nonce":3988723110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3988723110},{"type":"v1","addr":"172.21.15.142:6821","nonce":3988723110}]},"public_addr":"172.21.15.142:6817/3988723110","cluster_addr":"172.21.15.142:6819/3988723110","heartbeat_back_addr":"172.21.15.142:6823/3988723110","heartbeat_front_addr":"172.21.15.142:6821/3988723110","state":["exists","up"]},{"osd":7,"uuid":"17244599-2bdd-4fc9-bd49-044c8d9e340c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6825","nonce":1595351280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6827","nonce":1595351280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6831","nonce":1595351280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1595351280},{"type":"v1","addr":"172.21.15.142:6829","nonce":1595351280}]},"public_addr":"172.21.15.142:6825/1595351280","cluster_addr":"172.21.15.142:6827/1595351280","heartbeat_back_addr":"172.21.15.142:6831/1595351280","heartbeat_front_addr":"172.21.15.142:6829/1595351280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.757900+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.809275+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.502258+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.776550+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.429859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.765141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.696066+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T07:50:10.771148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.136:6837/2426434001":"2024-05-05T07:55:41.683829+0000","172.21.15.136:6836/2426434001":"2024-05-05T07:55:41.683829+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 msgr2=0x7f95c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 0x7f95c4078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001680 tx=0x7f95d8009040 comp rx=0 tx=0).stop 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 msgr2=0x7f95e4161aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009f70 tx=0x7f95dc004a40 comp rx=0 tx=0).stop 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 shutdown_connections 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f95c40762d0 0x7f95c4078790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95e415f650 0x7f95e4161aa0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95e40cf7b0 0x7f95e41521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:49.024 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 --2- 172.21.15.136:0/3121301312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e40b1f60 0x7f95e40c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:49.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.022+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 >> 172.21.15.136:0/3121301312 conn(0x7f95e40d2dd0 msgr2=0x7f95e4070100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:49.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.023+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 shutdown_connections 2024-05-04T07:55:49.025 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:49.023+0000 7f95ebc00640 1 -- 172.21.15.136:0/3121301312 wait complete. 2024-05-04T07:55:50.044 INFO:tasks.ceph:Scrubbing osd.0 2024-05-04T07:55:50.044 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:50.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.263+0000 7f65de400640 1 Processor -- start 2024-05-04T07:55:50.264 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.264+0000 7f65de400640 1 -- start start 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65de400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 0x7f65d80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65de400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65d80d1bb0 0x7f65d80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65de400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d80b67c0 con 0x7f65d815f7b0 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65de400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80d0a50 con 0x7f65d80d1bb0 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65de400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80b6200 con 0x7f65d815f3d0 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65d7e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f65d815f7b0 0x7f65d80d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56892/0 (socket says 172.21.15.136:56892) 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65d7e00640 1 -- 172.21.15.136:0/4154725502 learned_addr learned my addr 172.21.15.136:0/4154725502 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:50.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.265+0000 7f65dda00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65d80d1bb0 0x7f65d80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dd000640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 0x7f65d80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dda00640 1 -- 172.21.15.136:0/4154725502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 msgr2=0x7f65d80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65d7400640 1 -- 172.21.15.136:0/4154725502 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440952661 0 0) 0x7f65d80b67c0 con 0x7f65d815f7b0 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dda00640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 0x7f65d80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dda00640 1 -- 172.21.15.136:0/4154725502 >> v1:172.21.15.136:6789/0 conn(0x7f65d815f7b0 legacy=0x7f65d80d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dda00640 1 -- 172.21.15.136:0/4154725502 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d80b64e0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.267 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.266+0000 7f65dd000640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 0x7f65d80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.267+0000 7f65dda00640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d80b4460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f65d00097a0 tx=0x7f65d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5720fa33111b2d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.267+0000 7f65d7400640 1 -- 172.21.15.136:0/4154725502 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0037070 con 0x7f65d80d1bb0 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.267+0000 7f65d7400640 1 -- 172.21.15.136:0/4154725502 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d0032440 con 0x7f65d80d1bb0 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.267+0000 7f65d7400640 1 -- 172.21.15.136:0/4154725502 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0032810 con 0x7f65d80d1bb0 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 -- 172.21.15.136:0/4154725502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 msgr2=0x7f65d80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d80b4460 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f65d00097a0 tx=0x7f65d002a180 comp rx=0 tx=0).stop 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 -- 172.21.15.136:0/4154725502 shutdown_connections 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d80b4460 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 --2- 172.21.15.136:0/4154725502 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f3d0 0x7f65d80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.269 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 -- 172.21.15.136:0/4154725502 >> 172.21.15.136:0/4154725502 conn(0x7f65d80d4f20 msgr2=0x7f65d80d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 -- 172.21.15.136:0/4154725502 shutdown_connections 2024-05-04T07:55:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.268+0000 7f65de400640 1 -- 172.21.15.136:0/4154725502 wait complete. 2024-05-04T07:55:50.270 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.270+0000 7f65de400640 1 Processor -- start 2024-05-04T07:55:50.271 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.270+0000 7f65de400640 1 -- start start 2024-05-04T07:55:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d81622e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d815f3d0 0x7f65d815fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f7b0 0x7f65d81f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80d0ee0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.273 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80d2240 con 0x7f65d815f3d0 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65de400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80d1060 con 0x7f65d815f7b0 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65dd000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d81622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65dd000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d81622e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47392/0 (socket says 172.21.15.136:47392) 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.271+0000 7f65dd000640 1 -- 172.21.15.136:0/1964774428 learned_addr learned my addr 172.21.15.136:0/1964774428 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 -- 172.21.15.136:0/1964774428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f7b0 msgr2=0x7f65d81f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65d815f7b0 0x7f65d81f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.274 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 -- 172.21.15.136:0/1964774428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d815f3d0 msgr2=0x7f65d815fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d815f3d0 0x7f65d815fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81628e0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65dd000640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d81622e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f65c000c7f0 tx=0x7f65c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0015070 con 0x7f65d80d1bb0 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0007a30 con 0x7f65d80d1bb0 2024-05-04T07:55:50.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0007e00 con 0x7f65d80d1bb0 2024-05-04T07:55:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d8162bc0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.272+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81f48c0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.273+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65d80cd6a0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.275+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f65c0018070 con 0x7f65d80d1bb0 2024-05-04T07:55:50.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.275+0000 7f65d4c00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65b40762d0 0x7f65b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f65c00973b0 con 0x7f65d80d1bb0 2024-05-04T07:55:50.278 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d7e00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65b40762d0 0x7f65b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d4c00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f65b407c770 0x7f65b407ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65b407f280 con 0x7f65b407c770 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f65c009e050 con 0x7f65d80d1bb0 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65dda00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f65b407c770 0x7f65b407ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.276+0000 7f65d7e00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65b40762d0 0x7f65b4078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65c8007fd0 tx=0x7f65c8007ce0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.277+0000 7f65dda00640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f65b407c770 0x7f65b407ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.279 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.277+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== osd.0 v2:172.21.15.136:6801/3794668031 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65b407f280 con 0x7f65b407c770 2024-05-04T07:55:50.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.292+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 --> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65d8069400 con 0x7f65b407c770 2024-05-04T07:55:50.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.292+0000 7f65d4c00640 1 -- 172.21.15.136:0/1964774428 <== osd.0 v2:172.21.15.136:6801/3794668031 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f65d8069400 con 0x7f65b407c770 2024-05-04T07:55:50.293 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:50.293 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:50.293 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:50.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f65b407c770 msgr2=0x7f65b407ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6801/3794668031,v1:172.21.15.136:6803/3794668031] conn(0x7f65b407c770 0x7f65b407ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65b40762d0 msgr2=0x7f65b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f65b40762d0 0x7f65b4078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65c8007fd0 tx=0x7f65c8007ce0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 msgr2=0x7f65d81622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 --2- 172.21.15.136:0/1964774428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d80d1bb0 0x7f65d81622e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f65c000c7f0 tx=0x7f65c000cbf0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65dda00640 1 -- 172.21.15.136:0/1964774428 reap_dead start 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 shutdown_connections 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 >> 172.21.15.136:0/1964774428 conn(0x7f65d80d4f20 msgr2=0x7f65d80b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 shutdown_connections 2024-05-04T07:55:50.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.293+0000 7f65de400640 1 -- 172.21.15.136:0/1964774428 wait complete. 2024-05-04T07:55:50.312 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-04T07:55:50.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.514+0000 7f7ec8600640 1 Processor -- start 2024-05-04T07:55:50.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.515+0000 7f7ec8600640 1 -- start start 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec8600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec8600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ec00720b0 0x7f7ec0162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec8600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec00cc090 con 0x7f7ec0163370 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec8600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec00cbb10 con 0x7f7ec015f2d0 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec8600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec01637e0 con 0x7f7ec00720b0 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec5c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec5c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47400/0 (socket says 172.21.15.136:47400) 2024-05-04T07:55:50.517 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.516+0000 7f7ec5c00640 1 -- 172.21.15.136:0/179257415 learned_addr learned my addr 172.21.15.136:0/179257415 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:50.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.517+0000 7f7ec5200640 1 --2- 172.21.15.136:0/179257415 >> v2:172.21.15.142:3300/0 conn(0x7f7ec00720b0 0x7f7ec0162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.517+0000 7f7ec5c00640 1 -- 172.21.15.136:0/179257415 >> v2:172.21.15.142:3300/0 conn(0x7f7ec00720b0 msgr2=0x7f7ec0162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:50.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.517+0000 7f7ec5c00640 1 --2- 172.21.15.136:0/179257415 >> v2:172.21.15.142:3300/0 conn(0x7f7ec00720b0 0x7f7ec0162e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.517+0000 7f7ec5c00640 1 -- 172.21.15.136:0/179257415 >> v1:172.21.15.142:6789/0 conn(0x7f7ec0163370 legacy=0x7f7ec00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:50.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.517+0000 7f7ec5c00640 1 -- 172.21.15.136:0/179257415 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec00d0240 con 0x7f7ec015f2d0 2024-05-04T07:55:50.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.518+0000 7f7ec5c00640 1 --2- 172.21.15.136:0/179257415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0050de0 tx=0x7f7eb402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acbd82e0e8c646f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.518+0000 7f7ebfe00640 1 -- 172.21.15.136:0/179257415 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4036070 con 0x7f7ec015f2d0 2024-05-04T07:55:50.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.518+0000 7f7ebfe00640 1 -- 172.21.15.136:0/179257415 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb4031600 con 0x7f7ec015f2d0 2024-05-04T07:55:50.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.518+0000 7f7ebfe00640 1 -- 172.21.15.136:0/179257415 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40319d0 con 0x7f7ec015f2d0 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 -- 172.21.15.136:0/179257415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 msgr2=0x7f7ec00cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 --2- 172.21.15.136:0/179257415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0050de0 tx=0x7f7eb402a6c0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 -- 172.21.15.136:0/179257415 shutdown_connections 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 --2- 172.21.15.136:0/179257415 >> v2:172.21.15.142:3300/0 conn(0x7f7ec00720b0 0x7f7ec0162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 --2- 172.21.15.136:0/179257415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec00cb5d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 -- 172.21.15.136:0/179257415 >> 172.21.15.136:0/179257415 conn(0x7f7ec00d0c50 msgr2=0x7f7ec00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 -- 172.21.15.136:0/179257415 shutdown_connections 2024-05-04T07:55:50.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.519+0000 7f7ec8600640 1 -- 172.21.15.136:0/179257415 wait complete. 2024-05-04T07:55:50.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.521+0000 7f7ec8600640 1 Processor -- start 2024-05-04T07:55:50.521 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.521+0000 7f7ec8600640 1 -- start start 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec00720b0 0x7f7ec0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ec0163370 0x7f7ec00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec015f6b0 con 0x7f7ec015f2d0 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00cc370 con 0x7f7ec00720b0 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec8600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec0163b30 con 0x7f7ec0163370 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec5200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec5200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47410/0 (socket says 172.21.15.136:47410) 2024-05-04T07:55:50.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.522+0000 7f7ec5200640 1 -- 172.21.15.136:0/2707698912 learned_addr learned my addr 172.21.15.136:0/2707698912 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5c00640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec00720b0 0x7f7ec0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec6600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ec0163370 0x7f7ec00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 -- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ec0163370 msgr2=0x7f7ec00b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ec0163370 0x7f7ec00b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 -- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec00720b0 msgr2=0x7f7ec0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec00720b0 0x7f7ec0155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 -- 172.21.15.136:0/2707698912 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec0161160 con 0x7f7ec015f2d0 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec5200640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c7c0 tx=0x7f7eac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.525 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac015070 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eac007820 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.523+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec0161400 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.524+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac007bd0 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.524+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01619c0 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.525+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec00ce430 con 0x7f7ec015f2d0 2024-05-04T07:55:50.526 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.526+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7eac018070 con 0x7f7ec015f2d0 2024-05-04T07:55:50.527 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.527+0000 7f7ebd600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 0x7f7ea0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.527+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f7eac096f70 con 0x7f7ec015f2d0 2024-05-04T07:55:50.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.527+0000 7f7ec5c00640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 0x7f7ea0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.528 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.528+0000 7f7ec5c00640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 0x7f7ea0078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4033000 tx=0x7f7eb4009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.532+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7ec00ce430 con 0x7f7ec015f2d0 2024-05-04T07:55:50.736 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.735+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f7ec0069470 con 0x7f7ea00762d0 2024-05-04T07:55:50.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.736+0000 7f7ebd600640 1 -- 172.21.15.136:0/2707698912 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ec0069470 con 0x7f7ea00762d0 2024-05-04T07:55:50.737 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 0 to deep-scrub 2024-05-04T07:55:50.740 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 msgr2=0x7f7ea0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 0x7f7ea0078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4033000 tx=0x7f7eb4009000 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 msgr2=0x7f7ec01621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c7c0 tx=0x7f7eac00cc80 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 shutdown_connections 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7ea00762d0 0x7f7ea0078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ec0163370 0x7f7ec00b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ec015f2d0 0x7f7ec01621c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 --2- 172.21.15.136:0/2707698912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ec00720b0 0x7f7ec0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 >> 172.21.15.136:0/2707698912 conn(0x7f7ec00d0c50 msgr2=0x7f7ec00cdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 shutdown_connections 2024-05-04T07:55:50.741 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.740+0000 7f7ec8600640 1 -- 172.21.15.136:0/2707698912 wait complete. 2024-05-04T07:55:50.760 INFO:tasks.ceph:Scrubbing osd.1 2024-05-04T07:55:50.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:50.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.966+0000 7f2ee7e00640 1 Processor -- start 2024-05-04T07:55:50.967 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.966+0000 7f2ee7e00640 1 -- start start 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.967+0000 7f2ee7e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2ee815f3d0 0x7f2ee80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee80d1bb0 0x7f2ee80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee7e00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee80b67c0 con 0x7f2ee815f7b0 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee7e00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee80d0a50 con 0x7f2ee815f3d0 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80b6200 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.968 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2ee815f3d0 0x7f2ee80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2edfe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2ee815f7b0 0x7f2ee80d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56908/0 (socket says 172.21.15.136:56908) 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2edfe00640 1 -- 172.21.15.136:0/3130899130 learned_addr learned my addr 172.21.15.136:0/3130899130 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3130899130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee80d1bb0 msgr2=0x7f2ee80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6a00640 1 --2- 172.21.15.136:0/3130899130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee80d1bb0 0x7f2ee80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3130899130 >> v1:172.21.15.136:6789/0 conn(0x7f2ee815f7b0 legacy=0x7f2ee80d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6000640 1 -- 172.21.15.136:0/3130899130 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549535989 0 0) 0x7f2ee80b67c0 con 0x7f2ee815f7b0 2024-05-04T07:55:50.969 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.968+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3130899130 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80b64e0 con 0x7f2ee815f3d0 2024-05-04T07:55:50.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.969+0000 7f2ee6a00640 1 --2- 172.21.15.136:0/3130899130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee815f3d0 0x7f2ee80b3ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097a0 tx=0x7f2ed802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280215c8a1c091cb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee6000640 1 -- 172.21.15.136:0/3130899130 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8037070 con 0x7f2ee815f3d0 2024-05-04T07:55:50.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee6000640 1 -- 172.21.15.136:0/3130899130 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8032440 con 0x7f2ee815f3d0 2024-05-04T07:55:50.970 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee6000640 1 -- 172.21.15.136:0/3130899130 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8032810 con 0x7f2ee815f3d0 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3130899130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee815f3d0 msgr2=0x7f2ee80b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3130899130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee815f3d0 0x7f2ee80b3ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097a0 tx=0x7f2ed802a180 comp rx=0 tx=0).stop 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3130899130 shutdown_connections 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3130899130 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee80d1bb0 0x7f2ee80b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3130899130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee815f3d0 0x7f2ee80b3ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3130899130 >> 172.21.15.136:0/3130899130 conn(0x7f2ee80d4f20 msgr2=0x7f2ee80d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.971 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.970+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3130899130 shutdown_connections 2024-05-04T07:55:50.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.971+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3130899130 wait complete. 2024-05-04T07:55:50.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.972+0000 7f2ee7e00640 1 Processor -- start 2024-05-04T07:55:50.972 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.972+0000 7f2ee7e00640 1 -- start start 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 0x7f2ee815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee815f3d0 0x7f2ee80cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee815f7b0 0x7f2ee8160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80d0ee0 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80d2240 con 0x7f2ee815f3d0 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee7e00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80d1060 con 0x7f2ee815f7b0 2024-05-04T07:55:50.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.973+0000 7f2ee6a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 0x7f2ee815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 0x7f2ee815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47438/0 (socket says 172.21.15.136:47438) 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3397293936 learned_addr learned my addr 172.21.15.136:0/3397293936 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3397293936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee815f7b0 msgr2=0x7f2ee8160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee815f7b0 0x7f2ee8160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3397293936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee815f3d0 msgr2=0x7f2ee80cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee815f3d0 0x7f2ee80cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee815ff20 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.974+0000 7f2ee6a00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 0x7f2ee815d7b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097a0 tx=0x7f2ed80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.975+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8037040 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.975+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed8004250 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.975+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8032e20 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.975+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee8160200 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.975+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81607c0 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.976+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ee8069400 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.977+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ed8030770 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edea00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2ec40762d0 0x7f2ec4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f2ed80b8800 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edfe00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2ec40762d0 0x7f2ec4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edea00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f2ec407c770 0x7f2ec407ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ed803ce50 con 0x7f2ec407c770 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.978+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f2ed80bf050 con 0x7f2ee80d1bb0 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.979+0000 7f2ee7400640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f2ec407c770 0x7f2ec407ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:50.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.979+0000 7f2edfe00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2ec40762d0 0x7f2ec4078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007fd0 tx=0x7f2ed0007960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.979+0000 7f2ee7400640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f2ec407c770 0x7f2ec407ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:50.980 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.980+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== osd.1 v2:172.21.15.136:6800/1755931055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ed803ce50 con 0x7f2ec407c770 2024-05-04T07:55:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.994+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 --> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2ee8069b10 con 0x7f2ec407c770 2024-05-04T07:55:50.996 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.995+0000 7f2edea00640 1 -- 172.21.15.136:0/3397293936 <== osd.1 v2:172.21.15.136:6800/1755931055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2ee8069b10 con 0x7f2ec407c770 2024-05-04T07:55:50.997 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:50.997 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:50.997 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.995+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f2ec407c770 msgr2=0x7f2ec407ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.995+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6800/1755931055,v1:172.21.15.136:6802/1755931055] conn(0x7f2ec407c770 0x7f2ec407ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2ec40762d0 msgr2=0x7f2ec4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f2ec40762d0 0x7f2ec4078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0007fd0 tx=0x7f2ed0007960 comp rx=0 tx=0).stop 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 msgr2=0x7f2ee815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 --2- 172.21.15.136:0/3397293936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ee80d1bb0 0x7f2ee815d7b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80097a0 tx=0x7f2ed80046c0 comp rx=0 tx=0).stop 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7400640 1 -- 172.21.15.136:0/3397293936 reap_dead start 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 shutdown_connections 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 >> 172.21.15.136:0/3397293936 conn(0x7f2ee80d4f20 msgr2=0x7f2ee80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:50.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 shutdown_connections 2024-05-04T07:55:50.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:50.996+0000 7f2ee7e00640 1 -- 172.21.15.136:0/3397293936 wait complete. 2024-05-04T07:55:51.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-04T07:55:51.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.216+0000 7fe6dba00640 1 Processor -- start 2024-05-04T07:55:51.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.216+0000 7fe6dba00640 1 -- start start 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.217+0000 7fe6dba00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 0x7fe6d40cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.217+0000 7fe6dba00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6d40720b0 0x7fe6d4162e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.217+0000 7fe6dba00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d40cc090 con 0x7fe6d4163370 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.217+0000 7fe6dba00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d40cbb10 con 0x7fe6d40720b0 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.217+0000 7fe6dba00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d40b0450 con 0x7fe6d415f2d0 2024-05-04T07:55:51.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6d9a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6d4163370 0x7fe6d40cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56912/0 (socket says 172.21.15.136:56912) 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6d9a00640 1 -- 172.21.15.136:0/3387730285 learned_addr learned my addr 172.21.15.136:0/3387730285 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 0x7fe6d40cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3387730285 >> v2:172.21.15.142:3300/0 conn(0x7fe6d40720b0 0x7fe6d4162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658644191 0 0) 0x7fe6d40cc090 con 0x7fe6d4163370 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.218+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b8003520 con 0x7fe6d4163370 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3147041827 0 0) 0x7fe6b8003520 con 0x7fe6d4163370 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 msgr2=0x7fe6d40cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 0x7fe6d40cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 >> v2:172.21.15.142:3300/0 conn(0x7fe6d40720b0 msgr2=0x7fe6d4162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 --2- 172.21.15.136:0/3387730285 >> v2:172.21.15.142:3300/0 conn(0x7fe6d40720b0 0x7fe6d4162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d40d0240 con 0x7fe6d4163370 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7fe6cc001a70 con 0x7fe6d4163370 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 >> v1:172.21.15.136:6789/0 conn(0x7fe6d4163370 legacy=0x7fe6d40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.221 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8003aa0 0x7fe6b8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6b8004800 0x7fe6b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 0x7fe6b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d40cbb10 con 0x7fe6b8004800 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b800b9c0 con 0x7fe6b8003aa0 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b800bbc0 con 0x7fe6d415f2d0 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6b8004800 0x7fe6b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8003aa0 0x7fe6b8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 msgr2=0x7fe6b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d415f2d0 0x7fe6b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8003aa0 msgr2=0x7fe6b8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.219+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8003aa0 0x7fe6b8003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.220+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3387730285 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b8003520 con 0x7fe6b8004800 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6b8004800 0x7fe6b8004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009a90 tx=0x7fe6b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e4aa41af3a1608 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc036070 con 0x7fe6b8004800 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc031400 con 0x7fe6b8004800 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6d3e00640 1 -- 172.21.15.136:0/3387730285 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc009690 con 0x7fe6b8004800 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6dba00640 1 -- 172.21.15.136:0/3387730285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6b8004800 msgr2=0x7fe6b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3387730285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6b8004800 0x7fe6b8004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009a90 tx=0x7fe6b8005830 comp rx=0 tx=0).stop 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6d9a00640 1 -- 172.21.15.136:0/3387730285 reap_dead start 2024-05-04T07:55:51.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6dba00640 1 -- 172.21.15.136:0/3387730285 shutdown_connections 2024-05-04T07:55:51.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.221+0000 7fe6dba00640 1 -- 172.21.15.136:0/3387730285 >> 172.21.15.136:0/3387730285 conn(0x7fe6d40d0c50 msgr2=0x7fe6d40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:51.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.222+0000 7fe6dba00640 1 -- 172.21.15.136:0/3387730285 shutdown_connections 2024-05-04T07:55:51.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.222+0000 7fe6dba00640 1 -- 172.21.15.136:0/3387730285 wait complete. 2024-05-04T07:55:51.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.223+0000 7fe6dba00640 1 Processor -- start 2024-05-04T07:55:51.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.224+0000 7fe6dba00640 1 -- start start 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.224+0000 7fe6dba00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 0x7fe6d4161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6dba00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6dba00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d406f0a0 0x7fe6d406f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6dba00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d40cc370 con 0x7fe6d41f8c20 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6dba00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d415f6b0 con 0x7fe6b8004800 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6dba00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d4163b30 con 0x7fe6d406f0a0 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47466/0 (socket says 172.21.15.136:47466) 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3092447050 learned_addr learned my addr 172.21.15.136:0/3092447050 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6d9a00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d406f0a0 0x7fe6d406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 0x7fe6d4161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d406f0a0 msgr2=0x7fe6d406f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d406f0a0 0x7fe6d406f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 msgr2=0x7fe6d4161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 0x7fe6d4161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6cbe00640 1 -- 172.21.15.136:0/3092447050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d41f90a0 con 0x7fe6d41f8c20 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.225+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 0x7fe6d4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6cbe00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009bb0 tx=0x7fe6bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc040020 con 0x7fe6d41f8c20 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc003950 con 0x7fe6d41f8c20 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d4161a30 con 0x7fe6d41f8c20 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc036040 con 0x7fe6d41f8c20 2024-05-04T07:55:51.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.226+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d4161ff0 con 0x7fe6d41f8c20 2024-05-04T07:55:51.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.227+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d406fa60 con 0x7fe6d41f8c20 2024-05-04T07:55:51.229 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.228+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe6bc043020 con 0x7fe6d41f8c20 2024-05-04T07:55:51.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.229+0000 7fe6d1600640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 0x7fe6b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.230+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fe6bc0b7690 con 0x7fe6d41f8c20 2024-05-04T07:55:51.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.230+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 0x7fe6b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.230+0000 7fe6d9000640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 0x7fe6b0078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009910 tx=0x7fe6c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.234 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.234+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe6bc04a070 con 0x7fe6d41f8c20 2024-05-04T07:55:51.437 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.437+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe6d4069470 con 0x7fe6b00762d0 2024-05-04T07:55:51.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.438+0000 7fe6d1600640 1 -- 172.21.15.136:0/3092447050 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe6d4069470 con 0x7fe6b00762d0 2024-05-04T07:55:51.438 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 1 to deep-scrub 2024-05-04T07:55:51.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 msgr2=0x7fe6b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.441 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 0x7fe6b0078790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009910 tx=0x7fe6c4008040 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 msgr2=0x7fe6d41f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009bb0 tx=0x7fe6bc004730 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 shutdown_connections 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fe6b00762d0 0x7fe6b0078790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6d406f0a0 0x7fe6d406f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d41f8c20 0x7fe6d41f4330 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 --2- 172.21.15.136:0/3092447050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6b8004800 0x7fe6d4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.440+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 >> 172.21.15.136:0/3092447050 conn(0x7fe6d40d0c50 msgr2=0x7fe6d406e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.441+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 shutdown_connections 2024-05-04T07:55:51.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.441+0000 7fe6dba00640 1 -- 172.21.15.136:0/3092447050 wait complete. 2024-05-04T07:55:51.459 INFO:tasks.ceph:Scrubbing osd.2 2024-05-04T07:55:51.459 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:51.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.650+0000 7fa6a4200640 1 Processor -- start 2024-05-04T07:55:51.651 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.650+0000 7fa6a4200640 1 -- start start 2024-05-04T07:55:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a4200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa69c15cd90 0x7fa69c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a4200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 0x7fa69c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a4200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69c074150 con 0x7fa69c15d170 2024-05-04T07:55:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a4200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa69c1614c0 con 0x7fa69c15cd90 2024-05-04T07:55:51.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a4200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa69c06ef20 con 0x7fa69c0cd1e0 2024-05-04T07:55:51.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a1800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa69c15cd90 0x7fa69c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a1800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa69c15cd90 0x7fa69c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47468/0 (socket says 172.21.15.136:47468) 2024-05-04T07:55:51.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a1800640 1 -- 172.21.15.136:0/2857130149 learned_addr learned my addr 172.21.15.136:0/2857130149 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:51.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.652+0000 7fa6a2200640 1 --2- 172.21.15.136:0/2857130149 >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 0x7fa69c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.653+0000 7fa6a1800640 1 -- 172.21.15.136:0/2857130149 >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 msgr2=0x7fa69c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.653+0000 7fa6a1800640 1 --2- 172.21.15.136:0/2857130149 >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 0x7fa69c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.653+0000 7fa6a1800640 1 -- 172.21.15.136:0/2857130149 >> v1:172.21.15.136:6789/0 conn(0x7fa69c15d170 legacy=0x7fa69c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.653+0000 7fa6a1800640 1 -- 172.21.15.136:0/2857130149 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c160b90 con 0x7fa69c15cd90 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.653+0000 7fa6a2200640 1 --2- 172.21.15.136:0/2857130149 >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 0x7fa69c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.654+0000 7fa6a1800640 1 --2- 172.21.15.136:0/2857130149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c073a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa69c161430 tx=0x7fa69002a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82709be8d4575c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.654 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.654+0000 7fa69be00640 1 -- 172.21.15.136:0/2857130149 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690037070 con 0x7fa69c15cd90 2024-05-04T07:55:51.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.654+0000 7fa69be00640 1 -- 172.21.15.136:0/2857130149 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa690032440 con 0x7fa69c15cd90 2024-05-04T07:55:51.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.654+0000 7fa69be00640 1 -- 172.21.15.136:0/2857130149 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690032810 con 0x7fa69c15cd90 2024-05-04T07:55:51.655 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 -- 172.21.15.136:0/2857130149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 msgr2=0x7fa69c073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 --2- 172.21.15.136:0/2857130149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c073a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa69c161430 tx=0x7fa69002a280 comp rx=0 tx=0).stop 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 -- 172.21.15.136:0/2857130149 shutdown_connections 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 --2- 172.21.15.136:0/2857130149 >> v2:172.21.15.142:3300/0 conn(0x7fa69c0cd1e0 0x7fa69c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 --2- 172.21.15.136:0/2857130149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c073a70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 -- 172.21.15.136:0/2857130149 >> 172.21.15.136:0/2857130149 conn(0x7fa69c0d0bf0 msgr2=0x7fa69c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 -- 172.21.15.136:0/2857130149 shutdown_connections 2024-05-04T07:55:51.656 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.655+0000 7fa6a4200640 1 -- 172.21.15.136:0/2857130149 wait complete. 2024-05-04T07:55:51.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.656+0000 7fa6a4200640 1 Processor -- start 2024-05-04T07:55:51.657 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 -- start start 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa69c0cd1e0 0x7fa69c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c1f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa69c15d170 0x7fa69c1f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c161950 con 0x7fa69c15cd90 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c161150 con 0x7fa69c15d170 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.657+0000 7fa6a4200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa69c0ab9a0 con 0x7fa69c0cd1e0 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c1f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c1f6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47476/0 (socket says 172.21.15.136:47476) 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 -- 172.21.15.136:0/1742570697 learned_addr learned my addr 172.21.15.136:0/1742570697 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 -- 172.21.15.136:0/1742570697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa69c0cd1e0 msgr2=0x7fa69c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa69c0cd1e0 0x7fa69c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 -- 172.21.15.136:0/1742570697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa69c15d170 msgr2=0x7fa69c1f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.659 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa69c15d170 0x7fa69c1f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c1f7b40 con 0x7fa69c15cd90 2024-05-04T07:55:51.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.658+0000 7fa6a0e00640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c1f6ff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c370 tx=0x7fa68800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.660 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.659+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688017070 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.659+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6880052d0 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.659+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688003830 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.659+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c1f7e20 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.659+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1f83e0 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.660+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa69c0694e0 con 0x7fa69c15cd90 2024-05-04T07:55:51.661 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.661+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa68801a070 con 0x7fa69c15cd90 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa699600640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa67c0762d0 0x7fa67c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fa688096f90 con 0x7fa69c15cd90 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa699600640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fa67c07c770 0x7fa67c07ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa68801dec0 con 0x7fa67c07c770 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fa688097340 con 0x7fa69c15cd90 2024-05-04T07:55:51.663 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.662+0000 7fa6a1800640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa67c0762d0 0x7fa67c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.663+0000 7fa6a2200640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fa67c07c770 0x7fa67c07ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.663+0000 7fa6a1800640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa67c0762d0 0x7fa67c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa690034000 tx=0x7fa69002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.663+0000 7fa6a2200640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fa67c07c770 0x7fa67c07ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.664 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.664+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== osd.2 v2:172.21.15.136:6824/2411296812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa68801dec0 con 0x7fa67c07c770 2024-05-04T07:55:51.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.678+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 --> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa69c06fc30 con 0x7fa67c07c770 2024-05-04T07:55:51.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.679+0000 7fa699600640 1 -- 172.21.15.136:0/1742570697 <== osd.2 v2:172.21.15.136:6824/2411296812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa69c06fc30 con 0x7fa67c07c770 2024-05-04T07:55:51.679 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:51.680 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:51.680 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:51.680 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.679+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fa67c07c770 msgr2=0x7fa67c07ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.679+0000 7fa6a4200640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6824/2411296812,v1:172.21.15.136:6825/2411296812] conn(0x7fa67c07c770 0x7fa67c07ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa67c0762d0 msgr2=0x7fa67c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.681 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fa67c0762d0 0x7fa67c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa690034000 tx=0x7fa69002c000 comp rx=0 tx=0).stop 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 msgr2=0x7fa69c1f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 --2- 172.21.15.136:0/1742570697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa69c15cd90 0x7fa69c1f6ff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c370 tx=0x7fa68800c830 comp rx=0 tx=0).stop 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a2200640 1 -- 172.21.15.136:0/1742570697 reap_dead start 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 shutdown_connections 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 >> 172.21.15.136:0/1742570697 conn(0x7fa69c0d0bf0 msgr2=0x7fa69c0cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 shutdown_connections 2024-05-04T07:55:51.682 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.680+0000 7fa6a4200640 1 -- 172.21.15.136:0/1742570697 wait complete. 2024-05-04T07:55:51.697 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-04T07:55:51.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.885+0000 7f9a8f200640 1 Processor -- start 2024-05-04T07:55:51.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.885+0000 7f9a8f200640 1 -- start start 2024-05-04T07:55:51.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a8f200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a8815ad40 0x7f9a8806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a8f200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9a88073d50 0x7f9a880723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a8f200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a880701e0 con 0x7f9a88072920 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a8f200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8815df70 con 0x7f9a88073d50 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a8f200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8806ff90 con 0x7f9a8815ad40 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a87400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9a88073d50 0x7f9a880723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a87400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9a88073d50 0x7f9a880723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47486/0 (socket says 172.21.15.136:47486) 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a87400640 1 -- 172.21.15.136:0/4211103661 learned_addr learned my addr 172.21.15.136:0/4211103661 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:51.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.887+0000 7f9a87e00640 1 --2- 172.21.15.136:0/4211103661 >> v2:172.21.15.142:3300/0 conn(0x7f9a8815ad40 0x7f9a8806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.888+0000 7f9a87400640 1 -- 172.21.15.136:0/4211103661 >> v2:172.21.15.142:3300/0 conn(0x7f9a8815ad40 msgr2=0x7f9a8806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.888+0000 7f9a87400640 1 --2- 172.21.15.136:0/4211103661 >> v2:172.21.15.142:3300/0 conn(0x7f9a8815ad40 0x7f9a8806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.888+0000 7f9a87400640 1 -- 172.21.15.136:0/4211103661 >> v1:172.21.15.142:6789/0 conn(0x7f9a88072920 legacy=0x7f9a880cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:51.889 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.888+0000 7f9a87400640 1 -- 172.21.15.136:0/4211103661 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8815d640 con 0x7f9a88073d50 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.889+0000 7f9a87400640 1 --2- 172.21.15.136:0/4211103661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88073d50 0x7f9a880723e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a88076430 tx=0x7f9a7002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef4be8df0438984 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.889+0000 7f9a86a00640 1 -- 172.21.15.136:0/4211103661 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70037070 con 0x7f9a88073d50 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.889+0000 7f9a86a00640 1 -- 172.21.15.136:0/4211103661 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a70032440 con 0x7f9a88073d50 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.889+0000 7f9a86a00640 1 -- 172.21.15.136:0/4211103661 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70032810 con 0x7f9a88073d50 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 -- 172.21.15.136:0/4211103661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88073d50 msgr2=0x7f9a880723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 --2- 172.21.15.136:0/4211103661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88073d50 0x7f9a880723e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a88076430 tx=0x7f9a7002a1e0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 -- 172.21.15.136:0/4211103661 shutdown_connections 2024-05-04T07:55:51.892 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 --2- 172.21.15.136:0/4211103661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88073d50 0x7f9a880723e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 --2- 172.21.15.136:0/4211103661 >> v2:172.21.15.142:3300/0 conn(0x7f9a8815ad40 0x7f9a8806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 -- 172.21.15.136:0/4211103661 >> 172.21.15.136:0/4211103661 conn(0x7f9a880d0c50 msgr2=0x7f9a880d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 -- 172.21.15.136:0/4211103661 shutdown_connections 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.890+0000 7f9a8f200640 1 -- 172.21.15.136:0/4211103661 wait complete. 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.892+0000 7f9a8f200640 1 Processor -- start 2024-05-04T07:55:51.893 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.892+0000 7f9a8f200640 1 -- start start 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a88073d50 0x7f9a88149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 0x7f9a88153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a880731a0 con 0x7f9a88072920 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8815dc00 con 0x7f9a8815ad40 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8f200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8815e400 con 0x7f9a88073d50 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a87e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.896 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a87e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47492/0 (socket says 172.21.15.136:47492) 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a87e00640 1 -- 172.21.15.136:0/1428300126 learned_addr learned my addr 172.21.15.136:0/1428300126 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.893+0000 7f9a8d200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 0x7f9a88153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 -- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a88073d50 msgr2=0x7f9a88149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a88073d50 0x7f9a88149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 -- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 msgr2=0x7f9a88153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 0x7f9a88153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 -- 172.21.15.136:0/1428300126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a88159a00 con 0x7f9a88072920 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a8d200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 0x7f9a88153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a87e00640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9a78007e40 tx=0x7f9a7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78014620 con 0x7f9a88072920 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a78019070 con 0x7f9a88072920 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78014a00 con 0x7f9a88072920 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a880b3df0 con 0x7f9a88072920 2024-05-04T07:55:51.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.894+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a880b43b0 con 0x7f9a88072920 2024-05-04T07:55:51.898 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.895+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a88073490 con 0x7f9a88072920 2024-05-04T07:55:51.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.896+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9a78014ba0 con 0x7f9a88072920 2024-05-04T07:55:51.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.897+0000 7f9a7fe00640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 0x7f9a64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:51.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.897+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f9a78097e50 con 0x7f9a88072920 2024-05-04T07:55:51.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.898+0000 7f9a87400640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 0x7f9a64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:51.900 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.898+0000 7f9a87400640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 0x7f9a64078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9a70034000 tx=0x7f9a7002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:51.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:51.902+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9a88073490 con 0x7f9a88072920 2024-05-04T07:55:52.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.117+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9a88159ce0 con 0x7f9a640762d0 2024-05-04T07:55:52.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.118+0000 7f9a7fe00640 1 -- 172.21.15.136:0/1428300126 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9a88159ce0 con 0x7f9a640762d0 2024-05-04T07:55:52.119 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 2 to deep-scrub 2024-05-04T07:55:52.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 msgr2=0x7f9a64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.121 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 0x7f9a64078790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9a70034000 tx=0x7f9a7002c000 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 msgr2=0x7f9a88148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9a78007e40 tx=0x7f9a7800e4b0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 shutdown_connections 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9a640762d0 0x7f9a64078790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a8815ad40 0x7f9a88153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a88073d50 0x7f9a88149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 --2- 172.21.15.136:0/1428300126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a88072920 0x7f9a88148bd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.122 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.121+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 >> 172.21.15.136:0/1428300126 conn(0x7f9a880d0c50 msgr2=0x7f9a880b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:52.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.122+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 shutdown_connections 2024-05-04T07:55:52.123 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.122+0000 7f9a8f200640 1 -- 172.21.15.136:0/1428300126 wait complete. 2024-05-04T07:55:52.143 INFO:tasks.ceph:Scrubbing osd.3 2024-05-04T07:55:52.143 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:52.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.332+0000 7f9440800640 1 Processor -- start 2024-05-04T07:55:52.333 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.332+0000 7f9440800640 1 -- start start 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f9440800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f943815cd90 0x7f9438073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f9440800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f943815d170 0x7f943815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f9440800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9438074150 con 0x7f94380ccad0 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f9440800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f94381614c0 con 0x7f943815cd90 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f9440800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f943806ef20 con 0x7f943815d170 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f943de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f943815cd90 0x7f9438073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f943de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f943815cd90 0x7f9438073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47504/0 (socket says 172.21.15.136:47504) 2024-05-04T07:55:52.335 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.334+0000 7f943de00640 1 -- 172.21.15.136:0/4151731132 learned_addr learned my addr 172.21.15.136:0/4151731132 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:52.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.335+0000 7f943d400640 1 --2- 172.21.15.136:0/4151731132 >> v2:172.21.15.142:3300/0 conn(0x7f943815d170 0x7f943815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.335+0000 7f943de00640 1 -- 172.21.15.136:0/4151731132 >> v2:172.21.15.142:3300/0 conn(0x7f943815d170 msgr2=0x7f943815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:52.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.335+0000 7f943de00640 1 --2- 172.21.15.136:0/4151731132 >> v2:172.21.15.142:3300/0 conn(0x7f943815d170 0x7f943815e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.335+0000 7f943de00640 1 -- 172.21.15.136:0/4151731132 >> v1:172.21.15.142:6789/0 conn(0x7f94380ccad0 legacy=0x7f94380cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:52.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.335+0000 7f943de00640 1 -- 172.21.15.136:0/4151731132 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9438160b90 con 0x7f943815cd90 2024-05-04T07:55:52.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.336+0000 7f943de00640 1 --2- 172.21.15.136:0/4151731132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815cd90 0x7f9438073a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94380c7c50 tx=0x7f942c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5070d1b6fc747a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.336+0000 7f943ca00640 1 -- 172.21.15.136:0/4151731132 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c037070 con 0x7f943815cd90 2024-05-04T07:55:52.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.336+0000 7f943ca00640 1 -- 172.21.15.136:0/4151731132 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c032440 con 0x7f943815cd90 2024-05-04T07:55:52.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.336+0000 7f943ca00640 1 -- 172.21.15.136:0/4151731132 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c032810 con 0x7f943815cd90 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 -- 172.21.15.136:0/4151731132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815cd90 msgr2=0x7f9438073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 --2- 172.21.15.136:0/4151731132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815cd90 0x7f9438073a70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94380c7c50 tx=0x7f942c02a1e0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 -- 172.21.15.136:0/4151731132 shutdown_connections 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 --2- 172.21.15.136:0/4151731132 >> v2:172.21.15.142:3300/0 conn(0x7f943815d170 0x7f943815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 --2- 172.21.15.136:0/4151731132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815cd90 0x7f9438073a70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 -- 172.21.15.136:0/4151731132 >> 172.21.15.136:0/4151731132 conn(0x7f94380d0bf0 msgr2=0x7f94380d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 -- 172.21.15.136:0/4151731132 shutdown_connections 2024-05-04T07:55:52.338 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.337+0000 7f9440800640 1 -- 172.21.15.136:0/4151731132 wait complete. 2024-05-04T07:55:52.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.340+0000 7f9440800640 1 Processor -- start 2024-05-04T07:55:52.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.340+0000 7f9440800640 1 -- start start 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94380ccad0 0x7f94381e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943815cd90 0x7f94381f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 0x7f94381f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9438161950 con 0x7f943815d170 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9438161150 con 0x7f94380ccad0 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f9440800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f94381e7cf0 con 0x7f943815cd90 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f943e800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 0x7f94381f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f943e800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 0x7f94381f8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47512/0 (socket says 172.21.15.136:47512) 2024-05-04T07:55:52.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.341+0000 7f943e800640 1 -- 172.21.15.136:0/3376541948 learned_addr learned my addr 172.21.15.136:0/3376541948 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:52.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943de00640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94380ccad0 0x7f94381e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943d400640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943815cd90 0x7f94381f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 -- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943815cd90 msgr2=0x7f94381f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943815cd90 0x7f94381f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 -- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94380ccad0 msgr2=0x7f94381e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94380ccad0 0x7f94381e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94381e7fd0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.342+0000 7f943e800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 0x7f94381f8d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f943400c780 tx=0x7f943400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.343+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434017070 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.343+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9434003da0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.343+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340052b0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.343+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94381e82b0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.343+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94381e78c0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.344+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94380694e0 con 0x7f943815d170 2024-05-04T07:55:52.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.345+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f943401a070 con 0x7f943815d170 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.346+0000 7f9432000640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f941c0762d0 0x7f941c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.346+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f9434096bd0 con 0x7f943815d170 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.346+0000 7f943de00640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f941c0762d0 0x7f941c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.347+0000 7f9432000640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7f941c07c770 0x7f941c07ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.347+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f943401dec0 con 0x7f941c07c770 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.347+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f943409b2a0 con 0x7f943815d170 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.347+0000 7f943d400640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7f941c07c770 0x7f941c07ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.347+0000 7f943de00640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f941c0762d0 0x7f941c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f942c034000 tx=0x7f942c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.348+0000 7f943d400640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7f941c07c770 0x7f941c07ebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.348+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== osd.3 v2:172.21.15.136:6816/2323540888 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f943401dec0 con 0x7f941c07c770 2024-05-04T07:55:52.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.363+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 --> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f94381e8d60 con 0x7f941c07c770 2024-05-04T07:55:52.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.363+0000 7f9432000640 1 -- 172.21.15.136:0/3376541948 <== osd.3 v2:172.21.15.136:6816/2323540888 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f94381e8d60 con 0x7f941c07c770 2024-05-04T07:55:52.364 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:52.364 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:52.364 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7f941c07c770 msgr2=0x7f941c07ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6816/2323540888,v1:172.21.15.136:6817/2323540888] conn(0x7f941c07c770 0x7f941c07ebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f941c0762d0 msgr2=0x7f941c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f941c0762d0 0x7f941c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f942c034000 tx=0x7f942c02e000 comp rx=0 tx=0).stop 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 msgr2=0x7f94381f8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 --2- 172.21.15.136:0/3376541948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f943815d170 0x7f94381f8d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f943400c780 tx=0x7f943400cc40 comp rx=0 tx=0).stop 2024-05-04T07:55:52.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f943e800640 1 -- 172.21.15.136:0/3376541948 reap_dead start 2024-05-04T07:55:52.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 shutdown_connections 2024-05-04T07:55:52.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 >> 172.21.15.136:0/3376541948 conn(0x7f94380d0bf0 msgr2=0x7f94380cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:52.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 shutdown_connections 2024-05-04T07:55:52.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.364+0000 7f9440800640 1 -- 172.21.15.136:0/3376541948 wait complete. 2024-05-04T07:55:52.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-04T07:55:52.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.590+0000 7f2810800640 1 Processor -- start 2024-05-04T07:55:52.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.590+0000 7f2810800640 1 -- start start 2024-05-04T07:55:52.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f2810800640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2808160580 0x7f28080d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f2810800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 0x7f28080c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f2810800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28080c69e0 con 0x7f28080d3980 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f2810800640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f28080ce3f0 con 0x7f2808160580 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f2810800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f28080c6ce0 con 0x7f28080d1790 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f280de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2808160580 0x7f28080d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f280de00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2808160580 0x7f28080d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47516/0 (socket says 172.21.15.136:47516) 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f280de00640 1 -- 172.21.15.136:0/905456031 learned_addr learned my addr 172.21.15.136:0/905456031 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:52.593 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.592+0000 7f280d400640 1 --1- 172.21.15.136:0/905456031 >> v1:172.21.15.136:6789/0 conn(0x7f28080d3980 0x7f28080d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56930/0 (socket says 172.21.15.136:56930) 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280e800640 1 --2- 172.21.15.136:0/905456031 >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 0x7f28080c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280de00640 1 -- 172.21.15.136:0/905456031 >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 msgr2=0x7f28080c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280de00640 1 --2- 172.21.15.136:0/905456031 >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 0x7f28080c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280de00640 1 -- 172.21.15.136:0/905456031 >> v1:172.21.15.136:6789/0 conn(0x7f28080d3980 legacy=0x7f28080d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280de00640 1 -- 172.21.15.136:0/905456031 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28080ce640 con 0x7f2808160580 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280e800640 1 --2- 172.21.15.136:0/905456031 >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 0x7f28080c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:52.594 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.593+0000 7f280ca00640 1 -- 172.21.15.136:0/905456031 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529075363 0 0) 0x7f28080c69e0 con 0x7f28080d3980 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.594+0000 7f280de00640 1 --2- 172.21.15.136:0/905456031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2808160580 0x7f28080d09c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28080ceff0 tx=0x7f27fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b110ad6fb794f38b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.594+0000 7f280ca00640 1 -- 172.21.15.136:0/905456031 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc037070 con 0x7f2808160580 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.594+0000 7f280ca00640 1 -- 172.21.15.136:0/905456031 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27fc02ae50 con 0x7f2808160580 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.594+0000 7f280ca00640 1 -- 172.21.15.136:0/905456031 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc032860 con 0x7f2808160580 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 -- 172.21.15.136:0/905456031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2808160580 msgr2=0x7f28080d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 --2- 172.21.15.136:0/905456031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2808160580 0x7f28080d09c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28080ceff0 tx=0x7f27fc02a300 comp rx=0 tx=0).stop 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 -- 172.21.15.136:0/905456031 shutdown_connections 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 --2- 172.21.15.136:0/905456031 >> v2:172.21.15.142:3300/0 conn(0x7f28080d1790 0x7f28080c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 --2- 172.21.15.136:0/905456031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2808160580 0x7f28080d09c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 -- 172.21.15.136:0/905456031 >> 172.21.15.136:0/905456031 conn(0x7f28080d2df0 msgr2=0x7f28080d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 -- 172.21.15.136:0/905456031 shutdown_connections 2024-05-04T07:55:52.596 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.595+0000 7f2810800640 1 -- 172.21.15.136:0/905456031 wait complete. 2024-05-04T07:55:52.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.597+0000 7f2810800640 1 Processor -- start 2024-05-04T07:55:52.597 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.597+0000 7f2810800640 1 -- start start 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28080d1790 0x7f280815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2808160580 0x7f280815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2808160960 con 0x7f28080d3980 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f28080cec00 con 0x7f28080d1790 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f2810800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2808160ae0 con 0x7f2808160580 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f280d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f280d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47530/0 (socket says 172.21.15.136:47530) 2024-05-04T07:55:52.599 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.598+0000 7f280d400640 1 -- 172.21.15.136:0/1129534204 learned_addr learned my addr 172.21.15.136:0/1129534204 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280de00640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28080d1790 0x7f280815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280e800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2808160580 0x7f280815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 -- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2808160580 msgr2=0x7f280815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2808160580 0x7f280815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 -- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28080d1790 msgr2=0x7f280815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28080d1790 0x7f280815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 -- 172.21.15.136:0/1129534204 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280815ca50 con 0x7f28080d3980 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.599+0000 7f280d400640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f27f800c480 tx=0x7f27f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.600+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8018070 con 0x7f28080d3980 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.600+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f80074e0 con 0x7f28080d3980 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.600+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8004a20 con 0x7f28080d3980 2024-05-04T07:55:52.601 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.600+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2808158270 con 0x7f28080d3980 2024-05-04T07:55:52.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.600+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2808158830 con 0x7f28080d3980 2024-05-04T07:55:52.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.601+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808069470 con 0x7f28080d3980 2024-05-04T07:55:52.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.602+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f27f8004bc0 con 0x7f28080d3980 2024-05-04T07:55:52.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.603+0000 7f2802000640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 0x7f27ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:52.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.603+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f27f80967e0 con 0x7f28080d3980 2024-05-04T07:55:52.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.603+0000 7f280de00640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 0x7f27ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:52.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.604+0000 7f280de00640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 0x7f27ec078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27fc034000 tx=0x7f27fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:52.607 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.607+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f27f8060360 con 0x7f28080d3980 2024-05-04T07:55:52.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.812+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f28080cf370 con 0x7f27ec0762d0 2024-05-04T07:55:52.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.813+0000 7f2802000640 1 -- 172.21.15.136:0/1129534204 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f28080cf370 con 0x7f27ec0762d0 2024-05-04T07:55:52.813 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 3 to deep-scrub 2024-05-04T07:55:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.815+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 msgr2=0x7f27ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.815+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 0x7f27ec078790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27fc034000 tx=0x7f27fc02e000 comp rx=0 tx=0).stop 2024-05-04T07:55:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.815+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 msgr2=0x7f2808157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:52.816 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.815+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f27f800c480 tx=0x7f27f800c940 comp rx=0 tx=0).stop 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 shutdown_connections 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f27ec0762d0 0x7f27ec078790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2808160580 0x7f280815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28080d3980 0x7f2808157bd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 --2- 172.21.15.136:0/1129534204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28080d1790 0x7f280815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 >> 172.21.15.136:0/1129534204 conn(0x7f28080d2df0 msgr2=0x7f28080cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 shutdown_connections 2024-05-04T07:55:52.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:52.816+0000 7f2810800640 1 -- 172.21.15.136:0/1129534204 wait complete. 2024-05-04T07:55:52.835 INFO:tasks.ceph:Scrubbing osd.4 2024-05-04T07:55:52.835 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:53.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.043+0000 7fd7a1c00640 1 Processor -- start 2024-05-04T07:55:53.043 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.043+0000 7fd7a1c00640 1 -- start start 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd79c0ce7c0 0x7fd79c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 0x7fd79c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd79c1606a0 0x7fd79c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c0cf0e0 con 0x7fd79c1606a0 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c163250 con 0x7fd79c0ce7c0 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.044+0000 7fd7a1c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c163530 con 0x7fd79c1601f0 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd79c1606a0 0x7fd79c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.045 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd79c1606a0 0x7fd79c06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47544/0 (socket says 172.21.15.136:47544) 2024-05-04T07:55:53.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 -- 172.21.15.136:0/4117703710 learned_addr learned my addr 172.21.15.136:0/4117703710 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:53.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79aa00640 1 --2- 172.21.15.136:0/4117703710 >> v2:172.21.15.142:3300/0 conn(0x7fd79c0ce7c0 0x7fd79c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.046 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79a000640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 0x7fd79c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 -- 172.21.15.136:0/4117703710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 msgr2=0x7fd79c06e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 0x7fd79c06e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 -- 172.21.15.136:0/4117703710 >> v2:172.21.15.142:3300/0 conn(0x7fd79c0ce7c0 msgr2=0x7fd79c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 --2- 172.21.15.136:0/4117703710 >> v2:172.21.15.142:3300/0 conn(0x7fd79c0ce7c0 0x7fd79c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79b400640 1 -- 172.21.15.136:0/4117703710 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c163810 con 0x7fd79c1606a0 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.045+0000 7fd79a000640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 0x7fd79c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:53.047 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.046+0000 7fd79b400640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1606a0 0x7fd79c06e960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd79c06d2d0 tx=0x7fd79402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46526bb88127ea4 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.047+0000 7fd799600640 1 -- 172.21.15.136:0/4117703710 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794036070 con 0x7fd79c1606a0 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.047+0000 7fd799600640 1 -- 172.21.15.136:0/4117703710 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd794031600 con 0x7fd79c1606a0 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.047+0000 7fd799600640 1 -- 172.21.15.136:0/4117703710 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7940319d0 con 0x7fd79c1606a0 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.047+0000 7fd7a1c00640 1 -- 172.21.15.136:0/4117703710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1606a0 msgr2=0x7fd79c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.047+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1606a0 0x7fd79c06e960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd79c06d2d0 tx=0x7fd79402a6a0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 -- 172.21.15.136:0/4117703710 shutdown_connections 2024-05-04T07:55:53.048 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1601f0 0x7fd79c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/4117703710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1606a0 0x7fd79c06e960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/4117703710 >> v2:172.21.15.142:3300/0 conn(0x7fd79c0ce7c0 0x7fd79c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 -- 172.21.15.136:0/4117703710 >> 172.21.15.136:0/4117703710 conn(0x7fd79c0d0bf0 msgr2=0x7fd79c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 -- 172.21.15.136:0/4117703710 shutdown_connections 2024-05-04T07:55:53.049 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.048+0000 7fd7a1c00640 1 -- 172.21.15.136:0/4117703710 wait complete. 2024-05-04T07:55:53.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.049+0000 7fd7a1c00640 1 Processor -- start 2024-05-04T07:55:53.050 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.050+0000 7fd7a1c00640 1 -- start start 2024-05-04T07:55:53.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd79c0ce7c0 0x7fd79c0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 0x7fd79c14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1606a0 0x7fd79c0c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c163dd0 con 0x7fd79c1601f0 2024-05-04T07:55:53.051 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c162f20 con 0x7fd79c0ce7c0 2024-05-04T07:55:53.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd7a1c00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c159cd0 con 0x7fd79c1606a0 2024-05-04T07:55:53.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 0x7fd79c14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 0x7fd79c14af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47546/0 (socket says 172.21.15.136:47546) 2024-05-04T07:55:53.052 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 -- 172.21.15.136:0/1991728917 learned_addr learned my addr 172.21.15.136:0/1991728917 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79b400640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1606a0 0x7fd79c0c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79aa00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd79c0ce7c0 0x7fd79c0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 -- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1606a0 msgr2=0x7fd79c0c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd79c1606a0 0x7fd79c0c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 -- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd79c0ce7c0 msgr2=0x7fd79c0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd79c0ce7c0 0x7fd79c0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.051+0000 7fd79a000640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c0c6260 con 0x7fd79c1601f0 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd79a000640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 0x7fd79c14af00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c7f0 tx=0x7fd78400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784015070 con 0x7fd79c1601f0 2024-05-04T07:55:53.053 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7840079d0 con 0x7fd79c1601f0 2024-05-04T07:55:53.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784007da0 con 0x7fd79c1601f0 2024-05-04T07:55:53.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c14b440 con 0x7fd79c1601f0 2024-05-04T07:55:53.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.052+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c0c4f60 con 0x7fd79c1601f0 2024-05-04T07:55:53.054 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.053+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd79c073e90 con 0x7fd79c1601f0 2024-05-04T07:55:53.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.054+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd784018070 con 0x7fd79c1601f0 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.055+0000 7fd792a00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd7780762d0 0x7fd778078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7fd784097380 con 0x7fd79c1601f0 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd79aa00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd7780762d0 0x7fd778078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd792a00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7fd77807c770 0x7fd77807ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd77807f280 con 0x7fd77807c770 2024-05-04T07:55:53.056 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fd78409e050 con 0x7fd79c1601f0 2024-05-04T07:55:53.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd79aa00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd7780762d0 0x7fd778078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006fd0 tx=0x7fd78c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.057 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.056+0000 7fd79b400640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7fd77807c770 0x7fd77807ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.058 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.058+0000 7fd79b400640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7fd77807c770 0x7fd77807ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.060+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== osd.4 v2:172.21.15.142:6808/2527007446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd77807f280 con 0x7fd77807c770 2024-05-04T07:55:53.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.074+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 --> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd79c0694e0 con 0x7fd77807c770 2024-05-04T07:55:53.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.075+0000 7fd792a00640 1 -- 172.21.15.136:0/1991728917 <== osd.4 v2:172.21.15.142:6808/2527007446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd79c0694e0 con 0x7fd77807c770 2024-05-04T07:55:53.076 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:53.076 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:53.076 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:53.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7fd77807c770 msgr2=0x7fd77807ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.142:6808/2527007446,v1:172.21.15.142:6809/2527007446] conn(0x7fd77807c770 0x7fd77807ebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd7780762d0 msgr2=0x7fd778078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fd7780762d0 0x7fd778078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006fd0 tx=0x7fd78c008040 comp rx=0 tx=0).stop 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 msgr2=0x7fd79c14af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd7a1c00640 1 --2- 172.21.15.136:0/1991728917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd79c1601f0 0x7fd79c14af00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c7f0 tx=0x7fd78400cbf0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.076+0000 7fd79b400640 1 -- 172.21.15.136:0/1991728917 reap_dead start 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.077+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 shutdown_connections 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.077+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 >> 172.21.15.136:0/1991728917 conn(0x7fd79c0d0bf0 msgr2=0x7fd79c0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.077+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 shutdown_connections 2024-05-04T07:55:53.078 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.077+0000 7fd7a1c00640 1 -- 172.21.15.136:0/1991728917 wait complete. 2024-05-04T07:55:53.095 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-04T07:55:53.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.295+0000 7f474e400640 1 Processor -- start 2024-05-04T07:55:53.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.296+0000 7f474e400640 1 -- start start 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 0x7f474815df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47480c8020 0x7f47480cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480cc280 0x7f47480c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4748160aa0 con 0x7f47480c8020 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4748160cf0 con 0x7f474815ac50 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.297+0000 7f474e400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4748160fd0 con 0x7f47480cc280 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47480c8020 0x7f47480cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f47480c8020 0x7f47480cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47554/0 (socket says 172.21.15.136:47554) 2024-05-04T07:55:53.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 -- 172.21.15.136:0/1366920400 learned_addr learned my addr 172.21.15.136:0/1366920400 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:53.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4747400640 1 --2- 172.21.15.136:0/1366920400 >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 0x7f474815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4747e00640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480cc280 0x7f47480c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 -- 172.21.15.136:0/1366920400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480cc280 msgr2=0x7f47480c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480cc280 0x7f47480c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 -- 172.21.15.136:0/1366920400 >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 msgr2=0x7f474815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 --2- 172.21.15.136:0/1366920400 >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 0x7f474815df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4746a00640 1 -- 172.21.15.136:0/1366920400 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47481612b0 con 0x7f47480c8020 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.298+0000 7f4747400640 1 --2- 172.21.15.136:0/1366920400 >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 0x7f474815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:53.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.299+0000 7f4746a00640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480c8020 0x7f47480cbd40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4748068370 tx=0x7f473402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b04385b5ba0da server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f4746000640 1 -- 172.21.15.136:0/1366920400 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734037070 con 0x7f47480c8020 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f4746000640 1 -- 172.21.15.136:0/1366920400 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734032440 con 0x7f47480c8020 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f4746000640 1 -- 172.21.15.136:0/1366920400 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734032810 con 0x7f47480c8020 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 -- 172.21.15.136:0/1366920400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480c8020 msgr2=0x7f47480cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480c8020 0x7f47480cbd40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4748068370 tx=0x7f473402a1e0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 -- 172.21.15.136:0/1366920400 shutdown_connections 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480cc280 0x7f47480c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 --2- 172.21.15.136:0/1366920400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480c8020 0x7f47480cbd40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 --2- 172.21.15.136:0/1366920400 >> v2:172.21.15.142:3300/0 conn(0x7f474815ac50 0x7f474815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 -- 172.21.15.136:0/1366920400 >> 172.21.15.136:0/1366920400 conn(0x7f47480cdf60 msgr2=0x7f47480ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 -- 172.21.15.136:0/1366920400 shutdown_connections 2024-05-04T07:55:53.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.300+0000 7f474e400640 1 -- 172.21.15.136:0/1366920400 wait complete. 2024-05-04T07:55:53.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.302+0000 7f474e400640 1 Processor -- start 2024-05-04T07:55:53.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.302+0000 7f474e400640 1 -- start start 2024-05-04T07:55:53.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480c8020 0x7f4748152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480c8af0 0x7f47480ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47480c6d30 con 0x7f47480cc280 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4748161870 con 0x7f47480c8020 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.303+0000 7f474e400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47480c6eb0 con 0x7f47480c8af0 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47556/0 (socket says 172.21.15.136:47556) 2024-05-04T07:55:53.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 -- 172.21.15.136:0/3224142572 learned_addr learned my addr 172.21.15.136:0/3224142572 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4747400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480c8020 0x7f4748152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4747e00640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480c8af0 0x7f47480ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 -- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480c8af0 msgr2=0x7f47480ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480c8af0 0x7f47480ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 -- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480c8020 msgr2=0x7f4748152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480c8020 0x7f4748152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 -- 172.21.15.136:0/3224142572 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474806e7d0 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.304+0000 7f4746a00640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f473402a220 tx=0x7f47340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.305+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734037040 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.305+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734042070 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.305+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474815fe40 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.305+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734030bb0 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.305+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f474806ea70 con 0x7f47480cc280 2024-05-04T07:55:53.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.306+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47481f8670 con 0x7f47480cc280 2024-05-04T07:55:53.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.307+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4734047460 con 0x7f47480cc280 2024-05-04T07:55:53.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.308+0000 7f473f400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.308+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f47340b8150 con 0x7f47480cc280 2024-05-04T07:55:53.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.309+0000 7f4747400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.309+0000 7f4747400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 0x7f4728078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f473800a950 tx=0x7f4738008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.313 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.313+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4734081b90 con 0x7f47480cc280 2024-05-04T07:55:53.518 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.518+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f4748068640 con 0x7f47280762d0 2024-05-04T07:55:53.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.518+0000 7f473f400640 1 -- 172.21.15.136:0/3224142572 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4748068640 con 0x7f47280762d0 2024-05-04T07:55:53.519 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 4 to deep-scrub 2024-05-04T07:55:53.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 msgr2=0x7f4728078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 0x7f4728078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f473800a950 tx=0x7f4738008040 comp rx=0 tx=0).stop 2024-05-04T07:55:53.522 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 msgr2=0x7f47480c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f473402a220 tx=0x7f47340046c0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 shutdown_connections 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f47280762d0 0x7f4728078790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47480c8af0 0x7f47480ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47480cc280 0x7f47480c85b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 --2- 172.21.15.136:0/3224142572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47480c8020 0x7f4748152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.521+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 >> 172.21.15.136:0/3224142572 conn(0x7f47480cdf60 msgr2=0x7f47480ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.522+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 shutdown_connections 2024-05-04T07:55:53.523 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.522+0000 7f474e400640 1 -- 172.21.15.136:0/3224142572 wait complete. 2024-05-04T07:55:53.541 INFO:tasks.ceph:Scrubbing osd.5 2024-05-04T07:55:53.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.750+0000 7f8309400640 1 Processor -- start 2024-05-04T07:55:53.750 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.750+0000 7f8309400640 1 -- start start 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.751+0000 7f8309400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f83040b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.751+0000 7f8309400640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83040b67c0 con 0x7f830415f7b0 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.751+0000 7f8309400640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83040b6200 con 0x7f830415f3d0 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.751+0000 7f8309400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f83040d0a50 con 0x7f83040d1bb0 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.752+0000 7f8308a00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f830415f7b0 0x7f83040b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:56946/0 (socket says 172.21.15.136:56946) 2024-05-04T07:55:53.752 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.752+0000 7f8308a00640 1 -- 172.21.15.136:0/3484903776 learned_addr learned my addr 172.21.15.136:0/3484903776 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:53.754 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.752+0000 7f82fb400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f83040b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.752+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209031050 0 0) 0x7f83040b67c0 con 0x7f830415f7b0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.752+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e8003520 con 0x7f830415f7b0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575496758 0 0) 0x7f83040b6200 con 0x7f830415f3d0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83040b67c0 con 0x7f830415f3d0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026356409 0 0) 0x7f82e8003520 con 0x7f830415f7b0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 msgr2=0x7f83040b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f83040b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 >> v1:172.21.15.142:6789/0 conn(0x7f830415f3d0 legacy=0x7f83040d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83040b64e0 con 0x7f830415f7b0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f82fc001a70 con 0x7f830415f7b0 2024-05-04T07:55:53.755 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 >> v1:172.21.15.136:6789/0 conn(0x7f830415f7b0 legacy=0x7f83040b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e8003cb0 0x7f82e80040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e8004800 0x7f82e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f82e80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f83040d0a50 con 0x7f82e8003cb0 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82e800bbc0 con 0x7f82e8004800 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f82e800bdc0 con 0x7f83040d1bb0 2024-05-04T07:55:53.756 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.753+0000 7f8303e00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e8003cb0 0x7f82e80040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8308a00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f82e80052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f82fb400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e8004800 0x7f82e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8303e00640 1 -- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 msgr2=0x7f82e80052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8303e00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f82e80052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8303e00640 1 -- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e8004800 msgr2=0x7f82e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8303e00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e8004800 0x7f82e8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8303e00640 1 -- 172.21.15.136:0/3484903776 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e8003520 con 0x7f82e8003cb0 2024-05-04T07:55:53.757 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.754+0000 7f8308a00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f83040d1bb0 0x7f82e80052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8303e00640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e8003cb0 0x7f82e80040b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f82f4001900 tx=0x7f82e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b762bfba0aaa6310 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4001520 con 0x7f82e8003cb0 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f402acd0 con 0x7f82e8003cb0 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8303400640 1 -- 172.21.15.136:0/3484903776 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f4005310 con 0x7f82e8003cb0 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8309400640 1 -- 172.21.15.136:0/3484903776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e8003cb0 msgr2=0x7f82e80040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.755+0000 7f8309400640 1 --2- 172.21.15.136:0/3484903776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e8003cb0 0x7f82e80040b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f82f4001900 tx=0x7f82e8005830 comp rx=0 tx=0).stop 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.756+0000 7f8308a00640 1 -- 172.21.15.136:0/3484903776 reap_dead start 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.756+0000 7f8309400640 1 -- 172.21.15.136:0/3484903776 shutdown_connections 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.756+0000 7f8309400640 1 -- 172.21.15.136:0/3484903776 >> 172.21.15.136:0/3484903776 conn(0x7f83040d4f20 msgr2=0x7f83040d5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.756+0000 7f8309400640 1 -- 172.21.15.136:0/3484903776 shutdown_connections 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.756+0000 7f8309400640 1 -- 172.21.15.136:0/3484903776 wait complete. 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.757+0000 7f8309400640 1 Processor -- start 2024-05-04T07:55:53.761 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.758+0000 7f8309400640 1 -- start start 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e8003cb0 0x7f83040b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 0x7f83040c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83040cac60 0x7f83040b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f83040d0ee0 con 0x7f83040c85f0 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f83040d2240 con 0x7f83040cac60 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8309400640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f83040d1060 con 0x7f82e8003cb0 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 0x7f83040c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 0x7f83040c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:47560/0 (socket says 172.21.15.136:47560) 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 -- 172.21.15.136:0/1990963624 learned_addr learned my addr 172.21.15.136:0/1990963624 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8303e00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e8003cb0 0x7f83040b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f8308a00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83040cac60 0x7f83040b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.762 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 -- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e8003cb0 msgr2=0x7f83040b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e8003cb0 0x7f83040b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 -- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83040cac60 msgr2=0x7f83040b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83040cac60 0x7f83040b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.759+0000 7f82fb400640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83040ca340 con 0x7f83040c85f0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f82fb400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 0x7f83040c9e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82ec010890 tx=0x7f82ec010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00f040 con 0x7f83040c85f0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec00eb00 con 0x7f83040c85f0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec01c400 con 0x7f83040c85f0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83040c8d60 con 0x7f83040c85f0 2024-05-04T07:55:53.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.760+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83040c9320 con 0x7f83040c85f0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.761+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83040b3210 con 0x7f83040c85f0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.762+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82ec01c5a0 con 0x7f83040c85f0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.763+0000 7f8300c00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82e00762d0 0x7f82e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f82ec097b90 con 0x7f83040c85f0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8303e00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82e00762d0 0x7f82e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8300c00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7f82e007c770 0x7f82e007ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82ec008eb0 con 0x7f82e007c770 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f82ec09c2a0 con 0x7f83040c85f0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.764+0000 7f8303e00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82e00762d0 0x7f82e0078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f82f4031000 tx=0x7f82f4036040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.765+0000 7f8308a00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7f82e007c770 0x7f82e007ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:53.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.765+0000 7f8308a00640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7f82e007c770 0x7f82e007ebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:53.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.767+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== osd.5 v2:172.21.15.142:6800/2745467739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82ec008eb0 con 0x7f82e007c770 2024-05-04T07:55:53.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.782+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 --> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8304069400 con 0x7f82e007c770 2024-05-04T07:55:53.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.783+0000 7f8300c00640 1 -- 172.21.15.136:0/1990963624 <== osd.5 v2:172.21.15.142:6800/2745467739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8304069400 con 0x7f82e007c770 2024-05-04T07:55:53.784 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:53.784 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:53.784 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7f82e007c770 msgr2=0x7f82e007ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.142:6800/2745467739,v1:172.21.15.142:6801/2745467739] conn(0x7f82e007c770 0x7f82e007ebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82e00762d0 msgr2=0x7f82e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f82e00762d0 0x7f82e0078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f82f4031000 tx=0x7f82f4036040 comp rx=0 tx=0).stop 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 msgr2=0x7f83040c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 --2- 172.21.15.136:0/1990963624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83040c85f0 0x7f83040c9e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f82ec010890 tx=0x7f82ec010d50 comp rx=0 tx=0).stop 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8308a00640 1 -- 172.21.15.136:0/1990963624 reap_dead start 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 shutdown_connections 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 >> 172.21.15.136:0/1990963624 conn(0x7f83040d4f20 msgr2=0x7f83040b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 shutdown_connections 2024-05-04T07:55:53.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:53.784+0000 7f8309400640 1 -- 172.21.15.136:0/1990963624 wait complete. 2024-05-04T07:55:53.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-04T07:55:54.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.001+0000 7f13d6600640 1 Processor -- start 2024-05-04T07:55:54.002 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.001+0000 7f13d6600640 1 -- start start 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13d6600640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f13d00b8970 0x7f13d00d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13d6600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13d00d3870 0x7f13d00cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13d6600640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d00d2380 con 0x7f13d00cfb10 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13d6600640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f13d00cff80 con 0x7f13d00d3870 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13d6600640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f13d00cf210 con 0x7f13d00b8970 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13cea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13d00d3870 0x7f13d00cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13cea00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13d00d3870 0x7f13d00cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53424/0 (socket says 172.21.15.136:53424) 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.003+0000 7f13cea00640 1 -- 172.21.15.136:0/2622064979 learned_addr learned my addr 172.21.15.136:0/2622064979 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:54.004 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.004+0000 7f13cf400640 1 --2- 172.21.15.136:0/2622064979 >> v2:172.21.15.142:3300/0 conn(0x7f13d00b8970 0x7f13d00d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.004+0000 7f13cea00640 1 -- 172.21.15.136:0/2622064979 >> v2:172.21.15.142:3300/0 conn(0x7f13d00b8970 msgr2=0x7f13d00d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:54.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.004+0000 7f13cea00640 1 --2- 172.21.15.136:0/2622064979 >> v2:172.21.15.142:3300/0 conn(0x7f13d00b8970 0x7f13d00d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.004+0000 7f13cea00640 1 -- 172.21.15.136:0/2622064979 >> v1:172.21.15.142:6789/0 conn(0x7f13d00cfb10 legacy=0x7f13d006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:54.005 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.004+0000 7f13cea00640 1 -- 172.21.15.136:0/2622064979 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00cd440 con 0x7f13d00d3870 2024-05-04T07:55:54.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.005+0000 7f13cea00640 1 --2- 172.21.15.136:0/2622064979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d00cf5d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f13d006f690 tx=0x7f13b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019afeeac773bfa server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.005+0000 7f13ce000640 1 -- 172.21.15.136:0/2622064979 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8037070 con 0x7f13d00d3870 2024-05-04T07:55:54.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.005+0000 7f13ce000640 1 -- 172.21.15.136:0/2622064979 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8032440 con 0x7f13d00d3870 2024-05-04T07:55:54.006 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.005+0000 7f13ce000640 1 -- 172.21.15.136:0/2622064979 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8032810 con 0x7f13d00d3870 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 -- 172.21.15.136:0/2622064979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 msgr2=0x7f13d00cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 --2- 172.21.15.136:0/2622064979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d00cf5d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f13d006f690 tx=0x7f13b802a1e0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 -- 172.21.15.136:0/2622064979 shutdown_connections 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 --2- 172.21.15.136:0/2622064979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d00cf5d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 --2- 172.21.15.136:0/2622064979 >> v2:172.21.15.142:3300/0 conn(0x7f13d00b8970 0x7f13d00d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 -- 172.21.15.136:0/2622064979 >> 172.21.15.136:0/2622064979 conn(0x7f13d00d2d50 msgr2=0x7f13d00d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 -- 172.21.15.136:0/2622064979 shutdown_connections 2024-05-04T07:55:54.007 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.006+0000 7f13d6600640 1 -- 172.21.15.136:0/2622064979 wait complete. 2024-05-04T07:55:54.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.008+0000 7f13d6600640 1 Processor -- start 2024-05-04T07:55:54.008 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.008+0000 7f13d6600640 1 -- start start 2024-05-04T07:55:54.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13d00b8970 0x7f13d01f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 0x7f13d015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13d00cdce0 con 0x7f13d00d3870 2024-05-04T07:55:54.011 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f13d00cda00 con 0x7f13d00cfb10 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13d6600640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f13d00d2040 con 0x7f13d00b8970 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13cfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13cfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53440/0 (socket says 172.21.15.136:53440) 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.009+0000 7f13cfe00640 1 -- 172.21.15.136:0/1540937229 learned_addr learned my addr 172.21.15.136:0/1540937229 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cf400640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13d00b8970 0x7f13d01f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cea00640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 0x7f13d015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 -- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13d00b8970 msgr2=0x7f13d01f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13d00b8970 0x7f13d01f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 -- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 msgr2=0x7f13d015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 0x7f13d015aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 -- 172.21.15.136:0/1540937229 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01f5cc0 con 0x7f13d00d3870 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cea00640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 0x7f13d015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13cfe00640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f13c800b410 tx=0x7f13c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.010+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8015030 con 0x7f13d00d3870 2024-05-04T07:55:54.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.011+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8004020 con 0x7f13d00d3870 2024-05-04T07:55:54.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.011+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d0159930 con 0x7f13d00d3870 2024-05-04T07:55:54.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.011+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8004410 con 0x7f13d00d3870 2024-05-04T07:55:54.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.011+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d0159ef0 con 0x7f13d00d3870 2024-05-04T07:55:54.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.012+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d00caf20 con 0x7f13d00d3870 2024-05-04T07:55:54.013 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.013+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f13c8018070 con 0x7f13d00d3870 2024-05-04T07:55:54.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.014+0000 7f13c7400640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 0x7f13ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.014+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f13c8096f00 con 0x7f13d00d3870 2024-05-04T07:55:54.014 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.014+0000 7f13cf400640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 0x7f13ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.015 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.015+0000 7f13cf400640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 0x7f13ac078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13c00099c0 tx=0x7f13c0003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.018+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13c80609d0 con 0x7f13d00d3870 2024-05-04T07:55:54.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.227+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f13d0071d10 con 0x7f13ac0762d0 2024-05-04T07:55:54.228 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.228+0000 7f13c7400640 1 -- 172.21.15.136:0/1540937229 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13d0071d10 con 0x7f13ac0762d0 2024-05-04T07:55:54.228 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 5 to deep-scrub 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 msgr2=0x7f13ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 0x7f13ac078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f13c00099c0 tx=0x7f13c0003990 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 msgr2=0x7f13d015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f13c800b410 tx=0x7f13c800b8d0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 shutdown_connections 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f13ac0762d0 0x7f13ac078790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13d00d3870 0x7f13d015afb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13d00cfb10 0x7f13d015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 --2- 172.21.15.136:0/1540937229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13d00b8970 0x7f13d01f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.232 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 >> 172.21.15.136:0/1540937229 conn(0x7f13d00d2d50 msgr2=0x7f13d0071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 shutdown_connections 2024-05-04T07:55:54.233 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.231+0000 7f13d6600640 1 -- 172.21.15.136:0/1540937229 wait complete. 2024-05-04T07:55:54.250 INFO:tasks.ceph:Scrubbing osd.6 2024-05-04T07:55:54.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:54.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.459+0000 7f013b000640 1 Processor -- start 2024-05-04T07:55:54.460 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.459+0000 7f013b000640 1 -- start start 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.460+0000 7f013b000640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f013406eb10 0x7f013406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.460+0000 7f013b000640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013415dc60 con 0x7f01340b6050 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.460+0000 7f013b000640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013415df40 con 0x7f0134071d80 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.460+0000 7f013b000640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f01340cb530 con 0x7f013406eb10 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f013a600640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f013406eb10 0x7f013406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f0139c00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f01340b6050 0x7f013415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:35986/0 (socket says 172.21.15.136:35986) 2024-05-04T07:55:54.461 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f0139c00640 1 -- 172.21.15.136:0/1556726317 learned_addr learned my addr 172.21.15.136:0/1556726317 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:54.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f013a600640 1 -- 172.21.15.136:0/1556726317 >> v1:172.21.15.142:6789/0 conn(0x7f0134071d80 legacy=0x7f01340cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:54.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f013a600640 1 -- 172.21.15.136:0/1556726317 >> v1:172.21.15.136:6789/0 conn(0x7f01340b6050 legacy=0x7f013415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.461+0000 7f013a600640 1 -- 172.21.15.136:0/1556726317 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013415e220 con 0x7f013406eb10 2024-05-04T07:55:54.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.462+0000 7f013a600640 1 --2- 172.21.15.136:0/1556726317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f013406eb10 0x7f013406ef40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473598748282fed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f0133e00640 1 -- 172.21.15.136:0/1556726317 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c007740 con 0x7f013406eb10 2024-05-04T07:55:54.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f0133e00640 1 -- 172.21.15.136:0/1556726317 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c0078e0 con 0x7f013406eb10 2024-05-04T07:55:54.463 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f0133e00640 1 -- 172.21.15.136:0/1556726317 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c007cb0 con 0x7f013406eb10 2024-05-04T07:55:54.464 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 -- 172.21.15.136:0/1556726317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f013406eb10 msgr2=0x7f013406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 --2- 172.21.15.136:0/1556726317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f013406eb10 0x7f013406ef40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a660 comp rx=0 tx=0).stop 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 -- 172.21.15.136:0/1556726317 shutdown_connections 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 --2- 172.21.15.136:0/1556726317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f013406eb10 0x7f013406ef40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 -- 172.21.15.136:0/1556726317 >> 172.21.15.136:0/1556726317 conn(0x7f01340d0ad0 msgr2=0x7f01340d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 -- 172.21.15.136:0/1556726317 shutdown_connections 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.463+0000 7f013b000640 1 -- 172.21.15.136:0/1556726317 wait complete. 2024-05-04T07:55:54.465 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.465+0000 7f013b000640 1 Processor -- start 2024-05-04T07:55:54.466 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.465+0000 7f013b000640 1 -- start start 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013406eb10 0x7f013415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 0x7f01341e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01340b6050 0x7f01341f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f01340b6430 con 0x7f0134071d80 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f013406f480 con 0x7f013406eb10 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f013b000640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f01340cc0d0 con 0x7f01340b6050 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f0139200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 0x7f01341e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.466+0000 7f0139200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 0x7f01341e7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53462/0 (socket says 172.21.15.136:53462) 2024-05-04T07:55:54.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 -- 172.21.15.136:0/2178866745 learned_addr learned my addr 172.21.15.136:0/2178866745 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139c00640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013406eb10 0x7f013415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 -- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01340b6050 msgr2=0x7f01341f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01340b6050 0x7f01341f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 -- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013406eb10 msgr2=0x7f013415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013406eb10 0x7f013415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01341e7a10 con 0x7f0134071d80 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139c00640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f013406eb10 0x7f013415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0139200640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 0x7f01341e7190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f012000c460 tx=0x7f012000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.467+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120016020 con 0x7f0134071d80 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.468+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0120012870 con 0x7f0134071d80 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.468+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120012c60 con 0x7f0134071d80 2024-05-04T07:55:54.469 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.468+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01341e7cf0 con 0x7f0134071d80 2024-05-04T07:55:54.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.468+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341e82b0 con 0x7f0134071d80 2024-05-04T07:55:54.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.469+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0134069400 con 0x7f0134071d80 2024-05-04T07:55:54.470 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.470+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0120019020 con 0x7f0134071d80 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0131600640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f01140762d0 0x7f0114078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f0120097b70 con 0x7f0134071d80 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0139c00640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f01140762d0 0x7f0114078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0131600640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f011407c770 0x7f011407ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f012001eeb0 con 0x7f011407c770 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.471+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0120097f20 con 0x7f0134071d80 2024-05-04T07:55:54.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.472+0000 7f0139c00640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f01140762d0 0x7f0114078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0128000f60 tx=0x7f0128009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.472+0000 7f013a600640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f011407c770 0x7f011407ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.473 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.473+0000 7f013a600640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f011407c770 0x7f011407ebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.475 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.475+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== osd.6 v2:172.21.15.142:6816/3988723110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f012001eeb0 con 0x7f011407c770 2024-05-04T07:55:54.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.490+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 --> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0134073f40 con 0x7f011407c770 2024-05-04T07:55:54.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f0131600640 1 -- 172.21.15.136:0/2178866745 <== osd.6 v2:172.21.15.142:6816/3988723110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0134073f40 con 0x7f011407c770 2024-05-04T07:55:54.492 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:54.492 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:54.492 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f011407c770 msgr2=0x7f011407ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.142:6816/3988723110,v1:172.21.15.142:6817/3988723110] conn(0x7f011407c770 0x7f011407ebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f01140762d0 msgr2=0x7f0114078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f01140762d0 0x7f0114078790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0128000f60 tx=0x7f0128009040 comp rx=0 tx=0).stop 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 msgr2=0x7f01341e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 --2- 172.21.15.136:0/2178866745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0134071d80 0x7f01341e7190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f012000c460 tx=0x7f012000c920 comp rx=0 tx=0).stop 2024-05-04T07:55:54.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013a600640 1 -- 172.21.15.136:0/2178866745 reap_dead start 2024-05-04T07:55:54.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 shutdown_connections 2024-05-04T07:55:54.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.491+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 >> 172.21.15.136:0/2178866745 conn(0x7f01340d0ad0 msgr2=0x7f01340cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.492+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 shutdown_connections 2024-05-04T07:55:54.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.492+0000 7f013b000640 1 -- 172.21.15.136:0/2178866745 wait complete. 2024-05-04T07:55:54.511 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-04T07:55:54.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.712+0000 7feebfe00640 1 Processor -- start 2024-05-04T07:55:54.713 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.713+0000 7feebfe00640 1 -- start start 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.714+0000 7feebfe00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feec0145ad0 0x7feec00c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.714+0000 7feebfe00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feec00cb340 0x7feec00c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.714+0000 7feebfe00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec00ccfa0 con 0x7feec00c6d60 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.714+0000 7feebfe00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7feec0145eb0 con 0x7feec00cb340 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.714+0000 7feebfe00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feec00cd280 con 0x7feec0145ad0 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feebf400640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7feec00c6d60 0x7feec0160980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:35988/0 (socket says 172.21.15.136:35988) 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feebf400640 1 -- 172.21.15.136:0/3399082767 learned_addr learned my addr 172.21.15.136:0/3399082767 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:54.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feeb7e00640 1 --2- 172.21.15.136:0/3399082767 >> v2:172.21.15.136:3300/0 conn(0x7feec00cb340 0x7feec00c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feebea00640 1 --2- 172.21.15.136:0/3399082767 >> v2:172.21.15.142:3300/0 conn(0x7feec0145ad0 0x7feec00c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feebe000640 1 -- 172.21.15.136:0/3399082767 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169179217 0 0) 0x7feec00ccfa0 con 0x7feec00c6d60 2024-05-04T07:55:54.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feebe000640 1 -- 172.21.15.136:0/3399082767 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea4003520 con 0x7feec00c6d60 2024-05-04T07:55:54.716 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feeb7e00640 1 -- 172.21.15.136:0/3399082767 >> v2:172.21.15.142:3300/0 conn(0x7feec0145ad0 msgr2=0x7feec00c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:54.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feeb7e00640 1 --2- 172.21.15.136:0/3399082767 >> v2:172.21.15.142:3300/0 conn(0x7feec0145ad0 0x7feec00c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feeb7e00640 1 -- 172.21.15.136:0/3399082767 >> v1:172.21.15.136:6789/0 conn(0x7feec00c6d60 legacy=0x7feec0160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.717 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.715+0000 7feeb7e00640 1 -- 172.21.15.136:0/3399082767 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec00d0460 con 0x7feec00cb340 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.716+0000 7feeb7e00640 1 --2- 172.21.15.136:0/3399082767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00cb340 0x7feec00c6820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feec00719c0 tx=0x7feea802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d31026d0490580 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebe000640 1 -- 172.21.15.136:0/3399082767 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8037070 con 0x7feec00cb340 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebe000640 1 -- 172.21.15.136:0/3399082767 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8032440 con 0x7feec00cb340 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebe000640 1 -- 172.21.15.136:0/3399082767 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea80327f0 con 0x7feec00cb340 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 -- 172.21.15.136:0/3399082767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00cb340 msgr2=0x7feec00c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 --2- 172.21.15.136:0/3399082767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00cb340 0x7feec00c6820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feec00719c0 tx=0x7feea802a1a0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 -- 172.21.15.136:0/3399082767 shutdown_connections 2024-05-04T07:55:54.718 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 --2- 172.21.15.136:0/3399082767 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00cb340 0x7feec00c6820 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 --2- 172.21.15.136:0/3399082767 >> v2:172.21.15.142:3300/0 conn(0x7feec0145ad0 0x7feec00c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.717+0000 7feebfe00640 1 -- 172.21.15.136:0/3399082767 >> 172.21.15.136:0/3399082767 conn(0x7feec00cd490 msgr2=0x7feec00cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.718+0000 7feebfe00640 1 -- 172.21.15.136:0/3399082767 shutdown_connections 2024-05-04T07:55:54.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.718+0000 7feebfe00640 1 -- 172.21.15.136:0/3399082767 wait complete. 2024-05-04T07:55:54.719 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.719+0000 7feebfe00640 1 Processor -- start 2024-05-04T07:55:54.720 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.719+0000 7feebfe00640 1 -- start start 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec00cb340 0x7feec0141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0145ad0 0x7feec01449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feec00ccd40 con 0x7feec00c6d60 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feec00ccbc0 con 0x7feec0145ad0 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebfe00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feec00cf5f0 con 0x7feec00cb340 2024-05-04T07:55:54.721 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.720+0000 7feebea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53482/0 (socket says 172.21.15.136:53482) 2024-05-04T07:55:54.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 -- 172.21.15.136:0/2752596187 learned_addr learned my addr 172.21.15.136:0/2752596187 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 -- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec00cb340 msgr2=0x7feec0141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec00cb340 0x7feec0141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 -- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0145ad0 msgr2=0x7feec01449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0145ad0 0x7feec01449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 -- 172.21.15.136:0/2752596187 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec00b42c0 con 0x7feec00c6d60 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.721+0000 7feebea00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d5f0 tx=0x7feeb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.722+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00125f0 con 0x7feec00c6d60 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.722+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb0019070 con 0x7feec00c6d60 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.722+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec00b45a0 con 0x7feec00c6d60 2024-05-04T07:55:54.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.722+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00129d0 con 0x7feec00c6d60 2024-05-04T07:55:54.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.722+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec00b4e40 con 0x7feec00c6d60 2024-05-04T07:55:54.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.723+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec0069400 con 0x7feec00c6d60 2024-05-04T07:55:54.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.724+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeb0012b70 con 0x7feec00c6d60 2024-05-04T07:55:54.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.726+0000 7feeb7400640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:54.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.726+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7feeb0097960 con 0x7feec00c6d60 2024-05-04T07:55:54.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.726+0000 7feeb7e00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:54.727 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.727+0000 7feeb7e00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 0x7fee9c078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feea8034000 tx=0x7feea802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:54.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.731+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeb0061390 con 0x7feec00c6d60 2024-05-04T07:55:54.940 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.939+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7feec00ce2c0 con 0x7fee9c0762d0 2024-05-04T07:55:54.941 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.940+0000 7feeb7400640 1 -- 172.21.15.136:0/2752596187 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7feec00ce2c0 con 0x7fee9c0762d0 2024-05-04T07:55:54.941 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 6 to deep-scrub 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 msgr2=0x7fee9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 0x7fee9c078790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feea8034000 tx=0x7feea802c000 comp rx=0 tx=0).stop 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 msgr2=0x7feec00b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d5f0 tx=0x7feeb000dab0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 shutdown_connections 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7fee9c0762d0 0x7fee9c078790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.944 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feec0145ad0 0x7feec01449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feec00cb340 0x7feec0141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 --2- 172.21.15.136:0/2752596187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec00c6d60 0x7feec00b5640 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:54.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 >> 172.21.15.136:0/2752596187 conn(0x7feec00cd490 msgr2=0x7feec00ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:54.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.943+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 shutdown_connections 2024-05-04T07:55:54.945 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:54.944+0000 7feebfe00640 1 -- 172.21.15.136:0/2752596187 wait complete. 2024-05-04T07:55:54.963 INFO:tasks.ceph:Scrubbing osd.7 2024-05-04T07:55:54.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-04T07:55:55.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.164+0000 7f9e54a00640 1 Processor -- start 2024-05-04T07:55:55.165 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.164+0000 7f9e54a00640 1 -- start start 2024-05-04T07:55:55.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.165+0000 7f9e54a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500cced0 0x7f9e5015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.165+0000 7f9e54a00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e500afd50 0x7f9e50161770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e54a00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e500caeb0 con 0x7f9e500ccaf0 2024-05-04T07:55:55.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e54a00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9e50160d20 con 0x7f9e500afd50 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e54a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e50071dc0 con 0x7f9e500cced0 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e500afd50 0x7f9e50161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e500afd50 0x7f9e50161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53488/0 (socket says 172.21.15.136:53488) 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 -- 172.21.15.136:0/2815212179 learned_addr learned my addr 172.21.15.136:0/2815212179 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 -- 172.21.15.136:0/2815212179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500cced0 msgr2=0x7f9e5015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 --2- 172.21.15.136:0/2815212179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500cced0 0x7f9e5015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 -- 172.21.15.136:0/2815212179 >> v1:172.21.15.136:6789/0 conn(0x7f9e500ccaf0 legacy=0x7f9e5015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.166+0000 7f9e4f200640 1 -- 172.21.15.136:0/2815212179 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e500720a0 con 0x7f9e500afd50 2024-05-04T07:55:55.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.167+0000 7f9e4f200640 1 --2- 172.21.15.136:0/2815212179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500afd50 0x7f9e50161770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009e50 tx=0x7f9e4802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a09d33c8e0675c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e4de00640 1 -- 172.21.15.136:0/2815212179 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48036070 con 0x7f9e500afd50 2024-05-04T07:55:55.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e4de00640 1 -- 172.21.15.136:0/2815212179 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48031600 con 0x7f9e500afd50 2024-05-04T07:55:55.168 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e4de00640 1 -- 172.21.15.136:0/2815212179 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e480319d0 con 0x7f9e500afd50 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 -- 172.21.15.136:0/2815212179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500afd50 msgr2=0x7f9e50161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2815212179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500afd50 0x7f9e50161770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009e50 tx=0x7f9e4802a710 comp rx=0 tx=0).stop 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 -- 172.21.15.136:0/2815212179 shutdown_connections 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2815212179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500afd50 0x7f9e50161770 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2815212179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500cced0 0x7f9e5015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.169 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.168+0000 7f9e54a00640 1 -- 172.21.15.136:0/2815212179 >> 172.21.15.136:0/2815212179 conn(0x7f9e500d0ac0 msgr2=0x7f9e500d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:55.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.169+0000 7f9e54a00640 1 -- 172.21.15.136:0/2815212179 shutdown_connections 2024-05-04T07:55:55.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.169+0000 7f9e54a00640 1 -- 172.21.15.136:0/2815212179 wait complete. 2024-05-04T07:55:55.170 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.170+0000 7f9e54a00640 1 Processor -- start 2024-05-04T07:55:55.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.170+0000 7f9e54a00640 1 -- start start 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500afd50 0x7f9e500b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e500ccaf0 0x7f9e5014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 0x7f9e501f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9e500d15e0 con 0x7f9e500cced0 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50161250 con 0x7f9e500ccaf0 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e54a00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e500d1760 con 0x7f9e500afd50 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.171+0000 7f9e4f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 0x7f9e501f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 0x7f9e501f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53500/0 (socket says 172.21.15.136:53500) 2024-05-04T07:55:55.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 -- 172.21.15.136:0/2778544465 learned_addr learned my addr 172.21.15.136:0/2778544465 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:55.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 -- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500afd50 msgr2=0x7f9e500b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e500afd50 0x7f9e500b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 -- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e500ccaf0 msgr2=0x7f9e5014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e47e00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e500ccaf0 0x7f9e5014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e500ccaf0 0x7f9e5014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e501f50b0 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e47e00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e500ccaf0 0x7f9e5014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.172+0000 7f9e4f200640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 0x7f9e501f4b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009e50 tx=0x7f9e48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.173+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48036050 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.173+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48042070 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.173+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48009510 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.173+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501f5320 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.173+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501f58e0 con 0x7f9e500cced0 2024-05-04T07:55:55.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.174+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e501f81a0 con 0x7f9e500cced0 2024-05-04T07:55:55.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.175+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e48007bd0 con 0x7f9e500cced0 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.176+0000 7f9e46a00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9e2c0762d0 0x7f9e2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.176+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f9e480b9080 con 0x7f9e500cced0 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.176+0000 7f9e4e800640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9e2c0762d0 0x7f9e2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.177+0000 7f9e46a00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f9e2c07c770 0x7f9e2c07ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.177+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e2c07f280 con 0x7f9e2c07c770 2024-05-04T07:55:55.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.177+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9e480b9430 con 0x7f9e500cced0 2024-05-04T07:55:55.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.177+0000 7f9e4e800640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9e2c0762d0 0x7f9e2c078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e40000f60 tx=0x7f9e400079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.178 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.177+0000 7f9e47e00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f9e2c07c770 0x7f9e2c07ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.178+0000 7f9e47e00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f9e2c07c770 0x7f9e2c07ebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.180+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== osd.7 v2:172.21.15.142:6824/1595351280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e2c07f280 con 0x7f9e2c07c770 2024-05-04T07:55:55.196 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.195+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 --> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e50069400 con 0x7f9e2c07c770 2024-05-04T07:55:55.197 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.196+0000 7f9e46a00640 1 -- 172.21.15.136:0/2778544465 <== osd.7 v2:172.21.15.142:6824/1595351280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e50069400 con 0x7f9e2c07c770 2024-05-04T07:55:55.197 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-04T07:55:55.197 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T07:55:55.197 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f9e2c07c770 msgr2=0x7f9e2c07ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.142:6824/1595351280,v1:172.21.15.142:6825/1595351280] conn(0x7f9e2c07c770 0x7f9e2c07ebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9e2c0762d0 msgr2=0x7f9e2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f9e2c0762d0 0x7f9e2c078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e40000f60 tx=0x7f9e400079b0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 msgr2=0x7f9e501f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.198 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 --2- 172.21.15.136:0/2778544465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e500cced0 0x7f9e501f4b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009e50 tx=0x7f9e48004a40 comp rx=0 tx=0).stop 2024-05-04T07:55:55.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e4f200640 1 -- 172.21.15.136:0/2778544465 reap_dead start 2024-05-04T07:55:55.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 shutdown_connections 2024-05-04T07:55:55.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 >> 172.21.15.136:0/2778544465 conn(0x7f9e500d0ac0 msgr2=0x7f9e50160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:55.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 shutdown_connections 2024-05-04T07:55:55.199 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.197+0000 7f9e54a00640 1 -- 172.21.15.136:0/2778544465 wait complete. 2024-05-04T07:55:55.216 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-04T07:55:55.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.419+0000 7f31bee00640 1 Processor -- start 2024-05-04T07:55:55.420 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.419+0000 7f31bee00640 1 -- start start 2024-05-04T07:55:55.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31b80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bee00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31b80ce5e0 0x7f31b80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bee00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b80ccfa0 con 0x7f31b80cb340 2024-05-04T07:55:55.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bee00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f31b8145eb0 con 0x7f31b80ce5e0 2024-05-04T07:55:55.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80cd280 con 0x7f31b8145ad0 2024-05-04T07:55:55.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bd000640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f31b80cb340 0x7f31b80c6820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36010/0 (socket says 172.21.15.136:36010) 2024-05-04T07:55:55.422 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.421+0000 7f31bd000640 1 -- 172.21.15.136:0/1744276491 learned_addr learned my addr 172.21.15.136:0/1744276491 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31be400640 1 --2- 172.21.15.136:0/1744276491 >> v2:172.21.15.142:3300/0 conn(0x7f31b80ce5e0 0x7f31b80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31bda00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31b80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980900789 0 0) 0x7f31b80ccfa0 con 0x7f31b80cb340 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a0003520 con 0x7f31b80cb340 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3588967707 0 0) 0x7f31a0003520 con 0x7f31b80cb340 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 msgr2=0x7f31b80c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31b80c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 >> v2:172.21.15.142:3300/0 conn(0x7f31b80ce5e0 msgr2=0x7f31b80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.424 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 --2- 172.21.15.136:0/1744276491 >> v2:172.21.15.142:3300/0 conn(0x7f31b80ce5e0 0x7f31b80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b80d0460 con 0x7f31b80cb340 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f31a40016f0 con 0x7f31b80cb340 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 >> v1:172.21.15.136:6789/0 conn(0x7f31b80cb340 legacy=0x7f31b80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a0003aa0 0x7f31a0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8145eb0 con 0x7f31a0004d40 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80cd280 con 0x7f31a0003aa0 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.422+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f31a000ba40 con 0x7f31b8145ad0 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31bda00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a0003aa0 0x7f31a0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31bd000640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 -- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 msgr2=0x7f31a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.425 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b8145ad0 0x7f31a0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 -- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a0003aa0 msgr2=0x7f31a0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a0003aa0 0x7f31a0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31be400640 1 -- 172.21.15.136:0/1744276491 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a0003520 con 0x7f31a0004d40 2024-05-04T07:55:55.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.423+0000 7f31bda00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a0003aa0 0x7f31a0003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.424+0000 7f31be400640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31a00051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fc0 tx=0x7f31a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5bde903574b333 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.424+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0009c10 con 0x7f31a0004d40 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.424+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b0036070 con 0x7f31a0004d40 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.424+0000 7f31b7e00640 1 -- 172.21.15.136:0/1744276491 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b002d070 con 0x7f31a0004d40 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 -- 172.21.15.136:0/1744276491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 msgr2=0x7f31a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 --2- 172.21.15.136:0/1744276491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31a00051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fc0 tx=0x7f31a0005830 comp rx=0 tx=0).stop 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31be400640 1 -- 172.21.15.136:0/1744276491 reap_dead start 2024-05-04T07:55:55.427 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 -- 172.21.15.136:0/1744276491 shutdown_connections 2024-05-04T07:55:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 -- 172.21.15.136:0/1744276491 >> 172.21.15.136:0/1744276491 conn(0x7f31b80cd490 msgr2=0x7f31b80cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 -- 172.21.15.136:0/1744276491 shutdown_connections 2024-05-04T07:55:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.425+0000 7f31bee00640 1 -- 172.21.15.136:0/1744276491 wait complete. 2024-05-04T07:55:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.427+0000 7f31bee00640 1 Processor -- start 2024-05-04T07:55:55.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.427+0000 7f31bee00640 1 -- start start 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b81f2d60 0x7f31b80ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 0x7f31b806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80ccbc0 con 0x7f31a0004d40 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80c6f30 con 0x7f31b80ca690 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.428+0000 7f31bee00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80ccd40 con 0x7f31b81f2d60 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53520/0 (socket says 172.21.15.136:53520) 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 -- 172.21.15.136:0/1005164793 learned_addr learned my addr 172.21.15.136:0/1005164793 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31be400640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 0x7f31b806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 -- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b81f2d60 msgr2=0x7f31b80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.430 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bd000640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b81f2d60 0x7f31b80ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b81f2d60 0x7f31b80ca150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 -- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 msgr2=0x7f31b806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 0x7f31b806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 -- 172.21.15.136:0/1005164793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b80cabd0 con 0x7f31a0004d40 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31be400640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 0x7f31b806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:55:55.431 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.429+0000 7f31bda00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f31ac011600 tx=0x7f31ac011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.430+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00f920 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.430+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac00fac0 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.430+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00fe90 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.430+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b81420d0 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.430+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b8142690 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.431+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8070660 con 0x7f31a0004d40 2024-05-04T07:55:55.432 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.432+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f31ac015460 con 0x7f31a0004d40 2024-05-04T07:55:55.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.433+0000 7f31b5600640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 0x7f3198078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.433+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f31ac097e50 con 0x7f31a0004d40 2024-05-04T07:55:55.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.434+0000 7f31bd000640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 0x7f3198078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.434+0000 7f31bd000640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 0x7f3198078930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31b806d020 tx=0x7f31a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.438 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.438+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f31b8070660 con 0x7f31a0004d40 2024-05-04T07:55:55.648 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.648+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f31b80b37f0 con 0x7f3198076470 2024-05-04T07:55:55.649 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.649+0000 7f31b5600640 1 -- 172.21.15.136:0/1005164793 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31b80b37f0 con 0x7f3198076470 2024-05-04T07:55:55.650 INFO:teuthology.orchestra.run.smithi136.stderr:instructed osd(s) 7 to deep-scrub 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 msgr2=0x7f3198078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 0x7f3198078930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31b806d020 tx=0x7f31a4009040 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 msgr2=0x7f31b813b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f31ac011600 tx=0x7f31ac011ac0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 shutdown_connections 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f3198076470 0x7f3198078930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b80ca690 0x7f31b806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31b81f2d60 0x7f31b80ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 --2- 172.21.15.136:0/1005164793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31a0004d40 0x7f31b813b570 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.652 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.651+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 >> 172.21.15.136:0/1005164793 conn(0x7f31b80cd490 msgr2=0x7f31b8071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:55.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.652+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 shutdown_connections 2024-05-04T07:55:55.653 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.652+0000 7f31bee00640 1 -- 172.21.15.136:0/1005164793 wait complete. 2024-05-04T07:55:55.671 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:55:55.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.873+0000 7f7dbf200640 1 Processor -- start 2024-05-04T07:55:55.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.874+0000 7f7dbf200640 1 -- start start 2024-05-04T07:55:55.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbf200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7db815f2e0 0x7f7db8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbf200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db815f6c0 con 0x7f7db8073710 2024-05-04T07:55:55.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbf200640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db8071550 con 0x7f7db80710d0 2024-05-04T07:55:55.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbf200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7db8071830 con 0x7f7db815f2e0 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbd200640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7db8073710 0x7f7db80d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:36024/0 (socket says 172.21.15.136:36024) 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7dbd200640 1 -- 172.21.15.136:0/2709042938 learned_addr learned my addr 172.21.15.136:0/2709042938 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.875+0000 7f7db7e00640 1 --2- 172.21.15.136:0/2709042938 >> v2:172.21.15.142:3300/0 conn(0x7f7db815f2e0 0x7f7db8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959597161 0 0) 0x7f7db815f6c0 con 0x7f7db8073710 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d98005730 con 0x7f7db8073710 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238278993 0 0) 0x7f7d98005730 con 0x7f7db8073710 2024-05-04T07:55:55.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 >> v2:172.21.15.142:3300/0 conn(0x7f7db815f2e0 msgr2=0x7f7db8070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 --2- 172.21.15.136:0/2709042938 >> v2:172.21.15.142:3300/0 conn(0x7f7db815f2e0 0x7f7db8070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 >> v1:172.21.15.142:6789/0 conn(0x7f7db80710d0 legacy=0x7f7db8073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80cfaa0 con 0x7f7db8073710 2024-05-04T07:55:55.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f7db00016f0 con 0x7f7db8073710 2024-05-04T07:55:55.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 >> v1:172.21.15.136:6789/0 conn(0x7f7db8073710 legacy=0x7f7db80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 0x7f7d98006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d98006a10 0x7f7d98006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d980073d0 0x7f7d9800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8071830 con 0x7f7d98005c80 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9800e370 con 0x7f7d980073d0 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9800e570 con 0x7f7d98006a10 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.876+0000 7f7db7e00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 0x7f7d98006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7dbd200640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d980073d0 0x7f7d9800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7db7e00640 1 -- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d98006a10 msgr2=0x7f7d98006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7db7e00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d98006a10 0x7f7d98006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7db7e00640 1 -- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d980073d0 msgr2=0x7f7d9800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7db7e00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d980073d0 0x7f7d9800dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7db7e00640 1 -- 172.21.15.136:0/2709042938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d98005730 con 0x7f7d98005c80 2024-05-04T07:55:55.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.877+0000 7f7dbd200640 1 -- 172.21.15.136:0/2709042938 reap_dead start 2024-05-04T07:55:55.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.878+0000 7f7db7e00640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 0x7f7d98006080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009ac0 tx=0x7f7d98007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3fd8c8c265eede server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.878+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8036070 con 0x7f7d98005c80 2024-05-04T07:55:55.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.878+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8031400 con 0x7f7d98005c80 2024-05-04T07:55:55.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.878+0000 7f7db6a00640 1 -- 172.21.15.136:0/2709042938 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8009690 con 0x7f7d98005c80 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 -- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 msgr2=0x7f7d98006080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 0x7f7d98006080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009ac0 tx=0x7f7d98007a40 comp rx=0 tx=0).stop 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 -- 172.21.15.136:0/2709042938 shutdown_connections 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 --2- 172.21.15.136:0/2709042938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d98005c80 0x7f7d98006080 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 -- 172.21.15.136:0/2709042938 >> 172.21.15.136:0/2709042938 conn(0x7f7db80d1cc0 msgr2=0x7f7db80d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 -- 172.21.15.136:0/2709042938 shutdown_connections 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.879+0000 7f7dbf200640 1 -- 172.21.15.136:0/2709042938 wait complete. 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.881+0000 7f7dbf200640 1 Processor -- start 2024-05-04T07:55:55.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.881+0000 7f7dbf200640 1 -- start start 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d98005c80 0x7f7db81f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7db80b5a20 0x7f7db80cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7db81453c0 con 0x7f7db81f5010 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8145240 con 0x7f7d98005c80 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7dbf200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7db8070b90 con 0x7f7db80b5a20 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53540/0 (socket says 172.21.15.136:53540) 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 -- 172.21.15.136:0/3690304989 learned_addr learned my addr 172.21.15.136:0/3690304989 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 -- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7db80b5a20 msgr2=0x7f7db80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7db80b5a20 0x7f7db80cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 -- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d98005c80 msgr2=0x7f7db81f4ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d98005c80 0x7f7db81f4ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.882+0000 7f7db7400640 1 -- 172.21.15.136:0/3690304989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db81530e0 con 0x7f7db81f5010 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7db7400640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c680 tx=0x7f7da000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0016020 con 0x7f7db81f5010 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da000a7e0 con 0x7f7db81f5010 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da000ac10 con 0x7f7db81f5010 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db81533c0 con 0x7f7db81f5010 2024-05-04T07:55:55.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.883+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db8153980 con 0x7f7db81f5010 2024-05-04T07:55:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.884+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8069b10 con 0x7f7db81f5010 2024-05-04T07:55:55.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.886+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7da0019020 con 0x7f7db81f5010 2024-05-04T07:55:55.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.887+0000 7f7dafe00640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 0x7f7d94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:55:55.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.887+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f7da00976e0 con 0x7f7db81f5010 2024-05-04T07:55:55.887 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.887+0000 7f7db7e00640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 0x7f7d94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:55:55.888 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.888+0000 7f7db7e00640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 0x7f7d94078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7da8033000 tx=0x7f7da8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:55:55.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:55.891+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7da0020020 con 0x7f7db81f5010 2024-05-04T07:55:56.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.094+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7db806c440 con 0x7f7d940762d0 2024-05-04T07:55:56.097 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.097+0000 7f7dafe00640 1 -- 172.21.15.136:0/3690304989 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7f7db806c440 con 0x7f7d940762d0 2024-05-04T07:55:56.097 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:55:56.098 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:55:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 msgr2=0x7f7d94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 0x7f7d94078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7da8033000 tx=0x7f7da8008030 comp rx=0 tx=0).stop 2024-05-04T07:55:56.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 msgr2=0x7f7db80b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c680 tx=0x7f7da000cb40 comp rx=0 tx=0).stop 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 shutdown_connections 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f7d940762d0 0x7f7d94078790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7db80b5a20 0x7f7db80cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7db81f5010 0x7f7db80b54e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 --2- 172.21.15.136:0/3690304989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d98005c80 0x7f7db81f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.099+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 >> 172.21.15.136:0/3690304989 conn(0x7f7db80d1cc0 msgr2=0x7f7db815d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.100+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 shutdown_connections 2024-05-04T07:55:56.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:55:56.100+0000 7f7dbf200640 1 -- 172.21.15.136:0/3690304989 wait complete. 2024-05-04T07:55:56.118 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-05-04T07:55:55.372557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221412,"kb_used_data":5224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753308,"statfs":{"total":773094113280,"available":772867387392,"internally_reserved":0,"allocated":5349376,"data_stored":3000688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.333578"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":158,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-04T07:55:45.051782+0000","last_change":"2024-05-04T07:50:16.696595+0000","last_active":"2024-05-04T07:55:45.051782+0000","last_peered":"2024-05-04T07:55:45.051782+0000","last_clean":"2024-05-04T07:55:45.051782+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:55:45.051782+0000","last_undegraded":"2024-05-04T07:55:45.051782+0000","last_fullsized":"2024-05-04T07:55:45.051782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T07:50:15.333530+0000","last_clean_scrub_stamp":"2024-05-04T07:50:15.333530+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T15:56:36.924084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":817862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":817862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:55:56.121 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-04T07:50:15.333530+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=7, tm_min=50, tm_sec=15, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=7, tm_min=55, tm_sec=49, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T07:55:56.121 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-04T07:56:15.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:15.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:16.122 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T07:56:16.328 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.328+0000 7f754bc00640 1 Processor -- start 2024-05-04T07:56:16.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.328+0000 7f754bc00640 1 -- start start 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.329+0000 7f754bc00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f754413ff40 0x7f7544145e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f754bc00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7544072600 0x7f75440c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f754bc00640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7544146900 con 0x7f75441463a0 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f754bc00640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7544140320 con 0x7f754413ff40 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f754bc00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f754415de40 con 0x7f7544072600 2024-05-04T07:56:16.347 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7543e00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f75441463a0 0x7f7544071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:51156/0 (socket says 172.21.15.136:51156) 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7543e00640 1 -- 172.21.15.136:0/193490136 learned_addr learned my addr 172.21.15.136:0/193490136 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7549200640 1 --2- 172.21.15.136:0/193490136 >> v2:172.21.15.136:3300/0 conn(0x7f754413ff40 0x7f7544145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606766533 0 0) 0x7f7544146900 con 0x7f75441463a0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7549c00640 1 --2- 172.21.15.136:0/193490136 >> v2:172.21.15.142:3300/0 conn(0x7f7544072600 0x7f75440c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.330+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f752c003520 con 0x7f75441463a0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.331+0000 7f7549200640 1 -- 172.21.15.136:0/193490136 >> v2:172.21.15.142:3300/0 conn(0x7f7544072600 msgr2=0x7f75440c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.331+0000 7f7549200640 1 --2- 172.21.15.136:0/193490136 >> v2:172.21.15.142:3300/0 conn(0x7f7544072600 0x7f75440c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.331+0000 7f7549200640 1 -- 172.21.15.136:0/193490136 >> v1:172.21.15.136:6789/0 conn(0x7f75441463a0 legacy=0x7f7544071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.331+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488491689 0 0) 0x7f752c003520 con 0x7f75441463a0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.331+0000 7f7549200640 1 -- 172.21.15.136:0/193490136 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754415d7f0 con 0x7f754413ff40 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.332+0000 7f7549200640 1 --2- 172.21.15.136:0/193490136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f7544145e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7544146800 tx=0x7f753802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc976b129fcf93e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.348 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.332+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538037070 con 0x7f754413ff40 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.332+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753802abc0 con 0x7f754413ff40 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.332+0000 7f7543400640 1 -- 172.21.15.136:0/193490136 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300016f0 con 0x7f754413ff40 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 -- 172.21.15.136:0/193490136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 msgr2=0x7f7544145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 --2- 172.21.15.136:0/193490136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f7544145e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7544146800 tx=0x7f753802a130 comp rx=0 tx=0).stop 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 -- 172.21.15.136:0/193490136 shutdown_connections 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 --2- 172.21.15.136:0/193490136 >> v2:172.21.15.142:3300/0 conn(0x7f7544072600 0x7f75440c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 --2- 172.21.15.136:0/193490136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f7544145e60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 -- 172.21.15.136:0/193490136 >> 172.21.15.136:0/193490136 conn(0x7f75440d0c30 msgr2=0x7f75440d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 -- 172.21.15.136:0/193490136 shutdown_connections 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.333+0000 7f754bc00640 1 -- 172.21.15.136:0/193490136 wait complete. 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.335+0000 7f754bc00640 1 Processor -- start 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.335+0000 7f754bc00640 1 -- start start 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7544072600 0x7f754415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.349 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75441463a0 0x7f75440cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f754415d4a0 con 0x7f754413ff40 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7544161910 con 0x7f75441463a0 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f754bc00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f754415e2d0 con 0x7f7544072600 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f7543e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f7543e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60418/0 (socket says 172.21.15.136:60418) 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.336+0000 7f7543e00640 1 -- 172.21.15.136:0/2094583165 learned_addr learned my addr 172.21.15.136:0/2094583165 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7549200640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7544072600 0x7f754415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7549c00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75441463a0 0x7f75440cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 -- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7544072600 msgr2=0x7f754415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7544072600 0x7f754415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 -- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75441463a0 msgr2=0x7f75440cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75441463a0 0x7f75440cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 -- 172.21.15.136:0/2094583165 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75440b6680 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7543e00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f753000c5a0 tx=0x7f753000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530017070 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7530005ce0 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300072b0 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75440b6960 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.337+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75440b3c10 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.338+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7544069400 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.340+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f753001a070 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.341+0000 7f7540c00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 0x7f7524078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.341+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f7530096a60 con 0x7f754413ff40 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.341+0000 7f7549200640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 0x7f7524078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.342+0000 7f7549200640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 0x7f7524078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7538034000 tx=0x7f753802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.346+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7530060490 con 0x7f754413ff40 2024-05-04T07:56:16.547 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.546+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 --> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75440c7970 con 0x7f75240762d0 2024-05-04T07:56:16.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.548+0000 7f7540c00640 1 -- 172.21.15.136:0/2094583165 <== mgr.4098 v2:172.21.15.136:6832/2630771631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13345 (secure 0 0 0) 0x7f75440c7970 con 0x7f75240762d0 2024-05-04T07:56:16.549 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:56:16.549 INFO:teuthology.orchestra.run.smithi136.stderr:dumped all 2024-05-04T07:56:16.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 msgr2=0x7f7524078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 0x7f7524078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7538034000 tx=0x7f753802e000 comp rx=0 tx=0).stop 2024-05-04T07:56:16.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 msgr2=0x7f754413d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f753000c5a0 tx=0x7f753000ca60 comp rx=0 tx=0).stop 2024-05-04T07:56:16.552 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 shutdown_connections 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f75240762d0 0x7f7524078790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75441463a0 0x7f75440cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754413ff40 0x7f754413d380 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 --2- 172.21.15.136:0/2094583165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7544072600 0x7f754415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.551+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 >> 172.21.15.136:0/2094583165 conn(0x7f75440d0c30 msgr2=0x7f754415fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.552+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 shutdown_connections 2024-05-04T07:56:16.553 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.552+0000 7f754bc00640 1 -- 172.21.15.136:0/2094583165 wait complete. 2024-05-04T07:56:16.571 INFO:teuthology.orchestra.run.smithi136.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-05-04T07:56:15.378287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221400,"kb_used_data":5224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753320,"statfs":{"total":773094113280,"available":772867399680,"internally_reserved":0,"allocated":5349376,"data_stored":3000688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003447"},"pg_stats":[{"pgid":"1.0","version":"44'74","reported_seq":169,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-05-04T07:55:56.278246+0000","last_change":"2024-05-04T07:55:56.278320+0000","last_active":"2024-05-04T07:55:56.278246+0000","last_peered":"2024-05-04T07:55:56.278246+0000","last_clean":"2024-05-04T07:55:56.278246+0000","last_became_active":"2024-05-04T07:50:16.694210+0000","last_became_peered":"2024-05-04T07:50:16.694210+0000","last_unstale":"2024-05-04T07:55:56.278246+0000","last_undegraded":"2024-05-04T07:55:56.278246+0000","last_fullsized":"2024-05-04T07:55:56.278246+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'74","last_scrub_stamp":"2024-05-04T07:55:56.278070+0000","last_deep_scrub":"44'74","last_deep_scrub_stamp":"2024-05-04T07:55:56.278070+0000","last_clean_scrub_stamp":"2024-05-04T07:55:56.278070+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T17:00:56.182413+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1114112,"data_stored":817862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":227494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1114112,"data_stored":817862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T07:56:16.572 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-04T07:56:16.763 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.762+0000 7f4e77200640 1 Processor -- start 2024-05-04T07:56:16.764 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.763+0000 7f4e77200640 1 -- start start 2024-05-04T07:56:16.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e77200640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e7815f0e0 0x7f4e780d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e77200640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 0x7f4e780cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e77200640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e780d5e00 con 0x7f4e780d0420 2024-05-04T07:56:16.765 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e77200640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4e780b8850 con 0x7f4e7815f0e0 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e77200640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4e780d0a10 con 0x7f4e780cfa70 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e75e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e7815f0e0 0x7f4e780d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e76800640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f4e780d0420 0x7f4e780d2b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:51160/0 (socket says 172.21.15.136:51160) 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e76800640 1 -- 172.21.15.136:0/2581206700 learned_addr learned my addr 172.21.15.136:0/2581206700 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e75e00640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4e7815f0e0 0x7f4e780d58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60428/0 (socket says 172.21.15.136:60428) 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e75400640 1 --2- 172.21.15.136:0/2581206700 >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 0x7f4e780cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.764+0000 7f4e75e00640 1 -- 172.21.15.136:0/2581206700 >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 msgr2=0x7f4e780cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.765+0000 7f4e75e00640 1 --2- 172.21.15.136:0/2581206700 >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 0x7f4e780cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.765+0000 7f4e75e00640 1 -- 172.21.15.136:0/2581206700 >> v1:172.21.15.136:6789/0 conn(0x7f4e780d0420 legacy=0x7f4e780d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.765+0000 7f4e75e00640 1 -- 172.21.15.136:0/2581206700 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780d0cf0 con 0x7f4e7815f0e0 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.765+0000 7f4e74a00640 1 -- 172.21.15.136:0/2581206700 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722802762 0 0) 0x7f4e780d5e00 con 0x7f4e780d0420 2024-05-04T07:56:16.766 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.765+0000 7f4e75400640 1 --2- 172.21.15.136:0/2581206700 >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 0x7f4e780cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e75e00640 1 --2- 172.21.15.136:0/2581206700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e7815f0e0 0x7f4e780d58c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4e7808f4f0 tx=0x7f4e6802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccb810095da50ac server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e74a00640 1 -- 172.21.15.136:0/2581206700 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68037070 con 0x7f4e7815f0e0 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e74a00640 1 -- 172.21.15.136:0/2581206700 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68032440 con 0x7f4e7815f0e0 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e74a00640 1 -- 172.21.15.136:0/2581206700 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68032810 con 0x7f4e7815f0e0 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e77200640 1 -- 172.21.15.136:0/2581206700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e7815f0e0 msgr2=0x7f4e780d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.766+0000 7f4e77200640 1 --2- 172.21.15.136:0/2581206700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e7815f0e0 0x7f4e780d58c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4e7808f4f0 tx=0x7f4e6802a250 comp rx=0 tx=0).stop 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 -- 172.21.15.136:0/2581206700 shutdown_connections 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 --2- 172.21.15.136:0/2581206700 >> v2:172.21.15.142:3300/0 conn(0x7f4e780cfa70 0x7f4e780cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 --2- 172.21.15.136:0/2581206700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e7815f0e0 0x7f4e780d58c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 -- 172.21.15.136:0/2581206700 >> 172.21.15.136:0/2581206700 conn(0x7f4e7809e380 msgr2=0x7f4e780d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 -- 172.21.15.136:0/2581206700 shutdown_connections 2024-05-04T07:56:16.768 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.767+0000 7f4e77200640 1 -- 172.21.15.136:0/2581206700 wait complete. 2024-05-04T07:56:16.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.768+0000 7f4e77200640 1 Processor -- start 2024-05-04T07:56:16.769 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.768+0000 7f4e77200640 1 -- start start 2024-05-04T07:56:16.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e780cfa70 0x7f4e781f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e7815f0e0 0x7f4e7815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7815f4c0 con 0x7f4e780d0420 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b8d80 con 0x7f4e7815f0e0 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e77200640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780d3d40 con 0x7f4e780cfa70 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.769+0000 7f4e75400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60440/0 (socket says 172.21.15.136:60440) 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 -- 172.21.15.136:0/4007399884 learned_addr learned my addr 172.21.15.136:0/4007399884 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 -- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e780cfa70 msgr2=0x7f4e781f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e780cfa70 0x7f4e781f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 -- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e7815f0e0 msgr2=0x7f4e7815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e7815f0e0 0x7f4e7815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 -- 172.21.15.136:0/4007399884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e780b1be0 con 0x7f4e780d0420 2024-05-04T07:56:16.771 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e75400640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c7f0 tx=0x7f4e6000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60015070 con 0x7f4e780d0420 2024-05-04T07:56:16.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60007a30 con 0x7f4e780d0420 2024-05-04T07:56:16.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.770+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60007e00 con 0x7f4e780d0420 2024-05-04T07:56:16.772 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.771+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e780b1e80 con 0x7f4e780d0420 2024-05-04T07:56:16.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.771+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e781f4d00 con 0x7f4e780d0420 2024-05-04T07:56:16.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.772+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e78069400 con 0x7f4e780d0420 2024-05-04T07:56:16.773 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.773+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e60018070 con 0x7f4e780d0420 2024-05-04T07:56:16.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.774+0000 7f4e6e000640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 0x7f4e540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:16.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.774+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f4e600974d0 con 0x7f4e780d0420 2024-05-04T07:56:16.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.775+0000 7f4e75e00640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 0x7f4e540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:16.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.775+0000 7f4e75e00640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 0x7f4e540787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e68034000 tx=0x7f4e6802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:16.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.779+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e60060f00 con 0x7f4e780d0420 2024-05-04T07:56:16.985 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.984+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f4e780bac60 con 0x7f4e780d0420 2024-05-04T07:56:16.993 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.993+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f4e60060800 con 0x7f4e780d0420 2024-05-04T07:56:16.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.994+0000 7f4e6e000640 1 -- 172.21.15.136:0/4007399884 <== mon.0 v2:172.21.15.136:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4e6000ce40 con 0x7f4e780d0420 2024-05-04T07:56:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.996+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 msgr2=0x7f4e540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.996+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 0x7f4e540787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e68034000 tx=0x7f4e6802c000 comp rx=0 tx=0).stop 2024-05-04T07:56:16.997 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.996+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 msgr2=0x7f4e781f5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.996+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c7f0 tx=0x7f4e6000cbf0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 shutdown_connections 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f4e54076300 0x7f4e540787c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e7815f0e0 0x7f4e7815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e780d0420 0x7f4e781f5500 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 --2- 172.21.15.136:0/4007399884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e780cfa70 0x7f4e781f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 >> 172.21.15.136:0/4007399884 conn(0x7f4e7809e380 msgr2=0x7f4e7806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 shutdown_connections 2024-05-04T07:56:16.999 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:16.997+0000 7f4e77200640 1 -- 172.21.15.136:0/4007399884 wait complete. 2024-05-04T07:56:17.015 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-04T07:56:17.016 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T07:56:17.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.211+0000 7f6d47800640 1 Processor -- start 2024-05-04T07:56:17.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.211+0000 7f6d47800640 1 -- start start 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.213+0000 7f6d47800640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6d4015f190 0x7f6d400cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.213+0000 7f6d47800640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d4015f570 con 0x7f6d400cc6f0 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.213+0000 7f6d47800640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d400ccb80 con 0x7f6d400cf960 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.213+0000 7f6d47800640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6d400c6940 con 0x7f6d4015f190 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3fe00640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6d400cc6f0 0x7f6d400ae870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:51176/0 (socket says 172.21.15.136:51176) 2024-05-04T07:56:17.214 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3fe00640 1 -- 172.21.15.136:0/3906838389 learned_addr learned my addr 172.21.15.136:0/3906838389 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-05-04T07:56:17.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d44e00640 1 --2- 172.21.15.136:0/3906838389 >> v2:172.21.15.142:3300/0 conn(0x7f6d4015f190 0x7f6d400cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521113212 0 0) 0x7f6d28001490 con 0x7f6d400cc6f0 2024-05-04T07:56:17.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d24003520 con 0x7f6d400cc6f0 2024-05-04T07:56:17.216 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3906186069 0 0) 0x7f6d24003520 con 0x7f6d400cc6f0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 >> v2:172.21.15.142:3300/0 conn(0x7f6d4015f190 msgr2=0x7f6d400cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 --2- 172.21.15.136:0/3906838389 >> v2:172.21.15.142:3300/0 conn(0x7f6d4015f190 0x7f6d400cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 >> v1:172.21.15.142:6789/0 conn(0x7f6d400cf960 legacy=0x7f6d400cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400c6010 con 0x7f6d400cc6f0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2296522961 0 0) 0x7f6d28001c40 con 0x7f6d400cc6f0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.214+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 >> v1:172.21.15.136:6789/0 conn(0x7f6d400cc6f0 legacy=0x7f6d400ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 0x7f6d24003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24004800 0x7f6d24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d240052e0 0x7f6d2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400c6940 con 0x7f6d24003ac0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400c200 con 0x7f6d240052e0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2400c400 con 0x7f6d24004800 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 0x7f6d24003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d3fe00640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24004800 0x7f6d24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.217 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d45800640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d240052e0 0x7f6d2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 -- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24004800 msgr2=0x7f6d24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24004800 0x7f6d24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 -- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d240052e0 msgr2=0x7f6d2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d240052e0 0x7f6d2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.215+0000 7f6d44e00640 1 -- 172.21.15.136:0/3906838389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d24003520 con 0x7f6d24003ac0 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.216+0000 7f6d45800640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d240052e0 0x7f6d2400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-04T07:56:17.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.216+0000 7f6d45800640 1 -- 172.21.15.136:0/3906838389 reap_dead start 2024-05-04T07:56:17.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.217+0000 7f6d44e00640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 0x7f6d24003ec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba30 tx=0x7f6d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd9662bf62268bd server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:17.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.217+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30030070 con 0x7f6d24003ac0 2024-05-04T07:56:17.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.217+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6d3002ade0 con 0x7f6d24003ac0 2024-05-04T07:56:17.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.217+0000 7f6d3f400640 1 -- 172.21.15.136:0/3906838389 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000b600 con 0x7f6d24003ac0 2024-05-04T07:56:17.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 -- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 msgr2=0x7f6d24003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 0x7f6d24003ec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba30 tx=0x7f6d24005830 comp rx=0 tx=0).stop 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 -- 172.21.15.136:0/3906838389 shutdown_connections 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 --2- 172.21.15.136:0/3906838389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d24003ac0 0x7f6d24003ec0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 -- 172.21.15.136:0/3906838389 >> 172.21.15.136:0/3906838389 conn(0x7f6d400d0c30 msgr2=0x7f6d400d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 -- 172.21.15.136:0/3906838389 shutdown_connections 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.218+0000 7f6d47800640 1 -- 172.21.15.136:0/3906838389 wait complete. 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.220+0000 7f6d47800640 1 Processor -- start 2024-05-04T07:56:17.220 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.220+0000 7f6d47800640 1 -- start start 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24003ac0 0x7f6d400733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d401622f0 0x7f6d401591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400cb6d0 con 0x7f6d40160e40 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400c65d0 con 0x7f6d401622f0 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d47800640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400cb850 con 0x7f6d24003ac0 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.222 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:60450/0 (socket says 172.21.15.136:60450) 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 -- 172.21.15.136:0/323491836 learned_addr learned my addr 172.21.15.136:0/323491836 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d44e00640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24003ac0 0x7f6d400733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d3fe00640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d401622f0 0x7f6d401591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 -- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24003ac0 msgr2=0x7f6d400733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24003ac0 0x7f6d400733d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 -- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d401622f0 msgr2=0x7f6d401591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d401622f0 0x7f6d401591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.221+0000 7f6d45800640 1 -- 172.21.15.136:0/323491836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d40158430 con 0x7f6d40160e40 2024-05-04T07:56:17.223 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d45800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6d38005590 tx=0x7f6d3800d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38007020 con 0x7f6d40160e40 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6d380071c0 con 0x7f6d40160e40 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d380075d0 con 0x7f6d40160e40 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d40158710 con 0x7f6d40160e40 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.222+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d401612c0 con 0x7f6d40160e40 2024-05-04T07:56:17.224 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.224+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d40069400 con 0x7f6d40160e40 2024-05-04T07:56:17.225 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.225+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d3801a020 con 0x7f6d40160e40 2024-05-04T07:56:17.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.226+0000 7f6d3cc00640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 0x7f6d1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T07:56:17.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.226+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5335+0+0 (secure 0 0 0) 0x7f6d380967a0 con 0x7f6d40160e40 2024-05-04T07:56:17.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.226+0000 7f6d44e00640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 0x7f6d1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T07:56:17.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.227+0000 7f6d44e00640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 0x7f6d1c0787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba00 tx=0x7f6d30030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T07:56:17.230 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.230+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d380601e0 con 0x7f6d40160e40 2024-05-04T07:56:17.467 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.467+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d4015bed0 con 0x7f6d40160e40 2024-05-04T07:56:17.468 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.468+0000 7f6d3cc00640 1 -- 172.21.15.136:0/323491836 <== mon.0 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3881 (secure 0 0 0) 0x7f6d3805fae0 con 0x7f6d40160e40 2024-05-04T07:56:17.469 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-04T07:56:17.469 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4505,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2840568281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2840568281},{"type":"v1","addr":"172.21.15.142:6834","nonce":2840568281}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4651,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2266901478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2266901478},{"type":"v1","addr":"172.21.15.142:6835","nonce":2266901478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2784238107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2784238107},{"type":"v1","addr":"172.21.15.136:6835","nonce":2784238107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5142,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/1987504759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":1987504759},{"type":"v1","addr":"172.21.15.136:6837","nonce":1987504759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-05-04T07:56:17.469 INFO:teuthology.orchestra.run.smithi136.stderr:dumped fsmap epoch 21 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.470+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 msgr2=0x7f6d1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.470+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 0x7f6d1c0787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000ba00 tx=0x7f6d30030000 comp rx=0 tx=0).stop 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.470+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 msgr2=0x7f6d40071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.470+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6d38005590 tx=0x7f6d3800d5e0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 shutdown_connections 2024-05-04T07:56:17.471 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:6832/2630771631,v1:172.21.15.136:6833/2630771631] conn(0x7f6d1c076300 0x7f6d1c0787c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d40160e40 0x7f6d40071df0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d401622f0 0x7f6d401591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 --2- 172.21.15.136:0/323491836 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d24003ac0 0x7f6d400733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 >> 172.21.15.136:0/323491836 conn(0x7f6d400d0c30 msgr2=0x7f6d4015b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 shutdown_connections 2024-05-04T07:56:17.472 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-04T07:56:17.471+0000 7f6d47800640 1 -- 172.21.15.136:0/323491836 wait complete. 2024-05-04T07:56:17.489 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-04T07:56:17.489 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-04T07:56:17.489 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-04T07:56:17.489 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.507 INFO:tasks.ceph.mds.a:Stopped 2024-05-04T07:56:17.507 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-04T07:56:17.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.577 INFO:tasks.ceph.mds.c:Stopped 2024-05-04T07:56:17.577 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-04T07:56:17.577 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.603 INFO:tasks.ceph.mds.b:Stopped 2024-05-04T07:56:17.603 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-04T07:56:17.603 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.674 INFO:tasks.ceph.mds.d:Stopped 2024-05-04T07:56:17.674 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-04T07:56:17.675 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-04T07:56:17.675 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.717 INFO:tasks.ceph.osd.0:Stopped 2024-05-04T07:56:17.717 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-04T07:56:17.717 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.770 INFO:tasks.ceph.osd.1:Stopped 2024-05-04T07:56:17.771 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-04T07:56:17.771 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.845 INFO:tasks.ceph.osd.2:Stopped 2024-05-04T07:56:17.845 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-04T07:56:17.845 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.894 INFO:tasks.ceph.osd.3:Stopped 2024-05-04T07:56:17.894 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-04T07:56:17.895 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:17.942 INFO:tasks.ceph.osd.4:Stopped 2024-05-04T07:56:17.942 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-04T07:56:17.942 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.007 INFO:tasks.ceph.osd.5:Stopped 2024-05-04T07:56:18.007 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-04T07:56:18.008 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.064 INFO:tasks.ceph.osd.6:Stopped 2024-05-04T07:56:18.064 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-04T07:56:18.064 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.136 INFO:tasks.ceph.osd.7:Stopped 2024-05-04T07:56:18.136 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-04T07:56:18.137 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-04T07:56:18.137 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.212 INFO:tasks.ceph.mgr.y:Stopped 2024-05-04T07:56:18.212 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-04T07:56:18.212 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.282 INFO:tasks.ceph.mgr.x:Stopped 2024-05-04T07:56:18.282 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-04T07:56:18.282 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-04T07:56:18.282 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.314 INFO:tasks.ceph.mon.a:Stopped 2024-05-04T07:56:18.314 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-04T07:56:18.314 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.348 INFO:tasks.ceph.mon.b:Stopped 2024-05-04T07:56:18.349 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-04T07:56:18.349 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T07:56:18.426 INFO:tasks.ceph.mon.c:Stopped 2024-05-04T07:56:18.426 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-04T07:56:18.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-04T07:56:18.531 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:56:18.532 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-04T07:56:18.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:56:18.801 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-04T07:56:18.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:56:18.955 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-04T07:56:19.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:56:19.087 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-04T07:56:19.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:56:19.226 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-04T07:56:19.513 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:56:19.513 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-04T07:56:19.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:56:19.644 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-04T07:56:19.788 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:56:19.788 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-04T07:56:19.944 INFO:tasks.ceph:Archiving mon data... 2024-05-04T07:56:19.945 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/data/mon.a.tgz 2024-05-04T07:56:19.945 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-05-04T07:56:20.006 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.C9jYAgU71A 2024-05-04T07:56:20.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.C9jYAgU71A 2024-05-04T07:56:20.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.C9jYAgU71A 2024-05-04T07:56:20.326 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.C9jYAgU71A is 342KB 2024-05-04T07:56:20.397 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.C9jYAgU71A 2024-05-04T07:56:20.452 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/data/mon.b.tgz 2024-05-04T07:56:20.452 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-05-04T07:56:20.509 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.o1Yvojo19y 2024-05-04T07:56:20.510 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.o1Yvojo19y 2024-05-04T07:56:20.710 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.o1Yvojo19y 2024-05-04T07:56:20.851 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.o1Yvojo19y is 456KB 2024-05-04T07:56:20.966 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.o1Yvojo19y 2024-05-04T07:56:21.023 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/data/mon.c.tgz 2024-05-04T07:56:21.023 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-05-04T07:56:21.074 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.FYSD6K6diR 2024-05-04T07:56:21.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FYSD6K6diR 2024-05-04T07:56:21.257 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.FYSD6K6diR 2024-05-04T07:56:21.381 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.FYSD6K6diR is 456KB 2024-05-04T07:56:21.491 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.FYSD6K6diR 2024-05-04T07:56:21.548 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-04T07:56:21.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T07:56:21.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T07:56:21.701 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-04T07:56:21.756 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-04T07:56:21.757 INFO:tasks.ceph:Archiving crash dumps... 2024-05-04T07:56:21.759 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi136/crash 2024-05-04T07:56:21.759 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T07:56:21.846 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi142/crash 2024-05-04T07:56:21.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T07:56:21.933 INFO:tasks.ceph:Shutting down logrotate 2024-05-04T07:56:21.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:21.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:22.048 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:22.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T07:56:22.218 INFO:tasks.ceph:Compressing logs... 2024-05-04T07:56:22.219 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T07:56:22.226 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T07:56:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-05-04T07:56:22.307 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33965.log 2024-05-04T07:56:22.307 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101504.log 2024-05-04T07:56:22.308 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T07:56:22.308 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39209.log 2024-05-04T07:56:22.309 INFO:teuthology.orchestra.run.smithi136.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-05-04T07:56:22.310 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33965.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T07:56:22.310 INFO:teuthology.orchestra.run.smithi142.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33965.log.gz 2024-05-04T07:56:22.311 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-04T07:56:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102616.log 2024-05-04T07:56:22.311 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101504.log.gz 2024-05-04T07:56:22.311 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-05-04T07:56:22.311 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39209.log.gz 2024-05-04T07:56:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102616.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102616.log.gz 2024-05-04T07:56:22.312 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2024-05-04T07:56:22.314 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-04T07:56:22.314 INFO:teuthology.orchestra.run.smithi142.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T07:56:22.314 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-04T07:56:22.314 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T07:56:22.314 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102700.log 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2024-05-04T07:56:22.316 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-05-04T07:56:22.318 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34005.log 2024-05-04T07:56:22.318 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39653.log 2024-05-04T07:56:22.319 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.34005.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-04T07:56:22.319 INFO:teuthology.orchestra.run.smithi142.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34005.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102700.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38659.log 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102238.log 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38659.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102238.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102238.log.gz 2024-05-04T07:56:22.322 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2024-05-04T07:56:22.326 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.39653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39653.log.gz 2024-05-04T07:56:22.326 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33805.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.33805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33754.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41845.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gz 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2024-05-04T07:56:22.327 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2024-05-04T07:56:22.328 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41845.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.41845.log.gz 2024-05-04T07:56:22.328 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2024-05-04T07:56:22.328 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40763.log 2024-05-04T07:56:22.328 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2024-05-04T07:56:22.328 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-05-04T07:56:22.329 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33754.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-04T07:56:22.329 INFO:teuthology.orchestra.run.smithi142.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33805.log.gz 2024-05-04T07:56:22.329 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-05-04T07:56:22.330 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-05-04T07:56:22.330 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40763.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40763.log.gz 2024-05-04T07:56:22.330 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43159.log 2024-05-04T07:56:22.331 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102280.log 2024-05-04T07:56:22.331 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz 2024-05-04T07:56:22.331 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43159.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T07:56:22.331 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43159.log.gz 2024-05-04T07:56:22.332 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102280.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102280.log.gz 2024-05-04T07:56:22.332 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102154.log 2024-05-04T07:56:22.333 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103012.log 2024-05-04T07:56:22.333 INFO:teuthology.orchestra.run.smithi142.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-05-04T07:56:22.333 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33714.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-05-04T07:56:22.333 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33925.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-05-04T07:56:22.334 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-05-04T07:56:22.335 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33754.log.gz 2024-05-04T07:56:22.337 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102112.log 2024-05-04T07:56:22.337 INFO:teuthology.orchestra.run.smithi136.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102154.log.gz 2024-05-04T07:56:22.337 INFO:teuthology.orchestra.run.smithi136.stderr: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T07:56:22.337 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.103012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44984.log 2024-05-04T07:56:22.337 INFO:teuthology.orchestra.run.smithi136.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103012.log.gz 2024-05-04T07:56:22.338 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-05-04T07:56:22.338 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102112.log.gz 2024-05-04T07:56:22.338 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-05-04T07:56:22.338 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44984.log.gz 2024-05-04T07:56:22.342 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41635.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-04T07:56:22.342 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-05-04T07:56:22.342 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43772.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-05-04T07:56:22.342 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101588.log 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44938.log 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44199.log 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi136.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101588.log.gz 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44938.log: gzip -5 88.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44938.log.gz 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi136.stderr: -- /var/log/ceph/ceph-client.admin.40459.log 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40068.log 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-05-04T07:56:22.343 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.40068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40068.log.gz 2024-05-04T07:56:22.344 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-05-04T07:56:22.344 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-04T07:56:22.344 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.33885.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-05-04T07:56:22.346 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-04T07:56:22.346 INFO:teuthology.orchestra.run.smithi142.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44199.log.gz 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40459.log.gz 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43012.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43057.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101919.log 2024-05-04T07:56:22.348 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41433.log 2024-05-04T07:56:22.350 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-05-04T07:56:22.350 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T07:56:22.350 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101919.log.gz 2024-05-04T07:56:22.350 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-05-04T07:56:22.350 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41433.log.gz 2024-05-04T07:56:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-04T07:56:22.351 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43558.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-05-04T07:56:22.352 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43327.log 2024-05-04T07:56:22.352 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102868.log 2024-05-04T07:56:22.353 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-05-04T07:56:22.353 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100588.log 2024-05-04T07:56:22.353 INFO:teuthology.orchestra.run.smithi136.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43327.log.gz 2024-05-04T07:56:22.354 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40760.log 2024-05-04T07:56:22.354 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102868.log.gz 2024-05-04T07:56:22.355 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.100588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100588.log.gz 2024-05-04T07:56:22.355 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-04T07:56:22.356 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42565.log 2024-05-04T07:56:22.356 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40760.log.gz 2024-05-04T07:56:22.357 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-05-04T07:56:22.358 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.42565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-05-04T07:56:22.358 INFO:teuthology.orchestra.run.smithi136.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42565.log.gz 2024-05-04T07:56:22.359 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41929.log 2024-05-04T07:56:22.359 INFO:teuthology.orchestra.run.smithi136.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-05-04T07:56:22.360 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41103.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-05-04T07:56:22.360 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102532.log 2024-05-04T07:56:22.361 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-05-04T07:56:22.362 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102532.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41929.log.gz 2024-05-04T07:56:22.362 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102532.log.gz 2024-05-04T07:56:22.363 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40756.log 2024-05-04T07:56:22.364 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102742.log 2024-05-04T07:56:22.365 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44655.log: /var/log/ceph/ceph-client.admin.40756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102322.log 2024-05-04T07:56:22.365 INFO:teuthology.orchestra.run.smithi136.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-05-04T07:56:22.365 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40756.log.gz 2024-05-04T07:56:22.366 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2024-05-04T07:56:22.367 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102742.log.gz 2024-05-04T07:56:22.367 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102322.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102322.log.gz 2024-05-04T07:56:22.367 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38955.log 2024-05-04T07:56:22.369 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-05-04T07:56:22.369 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38955.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2024-05-04T07:56:22.369 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38955.log.gz 2024-05-04T07:56:22.369 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-05-04T07:56:22.370 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.33928.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-04T07:56:22.371 INFO:teuthology.orchestra.run.smithi136.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 2024-05-04T07:56:22.371 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45110.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-05-04T07:56:22.372 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101630.log 2024-05-04T07:56:22.373 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101327.log 2024-05-04T07:56:22.374 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101630.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101630.log.gz 2024-05-04T07:56:22.374 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-05-04T07:56:22.375 INFO:teuthology.orchestra.run.smithi136.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-04T07:56:22.375 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41438.log 2024-05-04T07:56:22.378 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101327.log.gz 2024-05-04T07:56:22.378 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: -3.0% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-05-04T07:56:22.378 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43947.log 2024-05-04T07:56:22.378 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101672.log 2024-05-04T07:56:22.378 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41438.log.gz 2024-05-04T07:56:22.379 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43820.log 2024-05-04T07:56:22.379 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43947.log.gz 2024-05-04T07:56:22.380 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2024-05-04T07:56:22.380 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101672.log.gz 2024-05-04T07:56:22.381 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-05-04T07:56:22.381 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43820.log.gz 2024-05-04T07:56:22.382 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41383.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-05-04T07:56:22.383 INFO:teuthology.orchestra.run.smithi136.stderr: -- /var/log/ceph/ceph-client.admin.39167.log 2024-05-04T07:56:22.383 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41719.log 2024-05-04T07:56:22.384 INFO:teuthology.orchestra.run.smithi136.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-05-04T07:56:22.385 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39167.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39167.log.gz 2024-05-04T07:56:22.385 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100659.log 2024-05-04T07:56:22.386 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41719.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-04T07:56:22.386 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41719.log.gz 2024-05-04T07:56:22.387 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.100659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100659.log.gz 2024-05-04T07:56:22.387 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-04T07:56:22.388 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101462.log 2024-05-04T07:56:22.389 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-04T07:56:22.391 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2024-05-04T07:56:22.391 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101462.log.gz 2024-05-04T07:56:22.392 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-05-04T07:56:22.394 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40249.log 2024-05-04T07:56:22.394 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gz 2024-05-04T07:56:22.395 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45344.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2024-05-04T07:56:22.396 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40249.log.gz 2024-05-04T07:56:22.397 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-05-04T07:56:22.398 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33559.log 2024-05-04T07:56:22.399 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38453.log 2024-05-04T07:56:22.400 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-05-04T07:56:22.401 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.33559.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.33559.log.gz 2024-05-04T07:56:22.402 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38453.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38453.log.gz 2024-05-04T07:56:22.402 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-05-04T07:56:22.404 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2024-05-04T07:56:22.405 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101546.log 2024-05-04T07:56:22.406 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-05-04T07:56:22.407 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40070.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2024-05-04T07:56:22.408 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101546.log.gz 2024-05-04T07:56:22.408 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102406.log 2024-05-04T07:56:22.409 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-05-04T07:56:22.411 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102406.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27532.log 2024-05-04T07:56:22.411 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102406.log.gz 2024-05-04T07:56:22.412 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44697.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-05-04T07:56:22.414 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose/var/log/ceph/ceph.tmp-client.admin.27532.log: -- /var/log/ceph/ceph-client.admin.45068.log 2024-05-04T07:56:22.414 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27532.log.gz 2024-05-04T07:56:22.414 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100672.log 2024-05-04T07:56:22.416 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45152.log 2024-05-04T07:56:22.417 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45068.log.gz 2024-05-04T07:56:22.417 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.100672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100672.log.gz 2024-05-04T07:56:22.418 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45152.log.gz 2024-05-04T07:56:22.419 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41094.log 2024-05-04T07:56:22.420 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-05-04T07:56:22.422 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41439.log 2024-05-04T07:56:22.422 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41094.log.gz 2024-05-04T07:56:22.423 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40749.log 2024-05-04T07:56:22.423 INFO:teuthology.orchestra.run.smithi136.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-05-04T07:56:22.424 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41439.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41439.log.gz 2024-05-04T07:56:22.425 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40749.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 2024-05-04T07:56:22.426 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 2024-05-04T07:56:22.428 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2024-05-04T07:56:22.429 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.33828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42412.log 2024-05-04T07:56:22.429 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-05-04T07:56:22.430 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44403.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2024-05-04T07:56:22.431 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.0.42412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42412.log.gz 2024-05-04T07:56:22.431 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40501.log 2024-05-04T07:56:22.432 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-04T07:56:22.434 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101817.log 2024-05-04T07:56:22.434 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40501.log.gz 2024-05-04T07:56:22.437 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.101817.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102784.log 2024-05-04T07:56:22.438 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101817.log.gz 2024-05-04T07:56:22.439 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2024-05-04T07:56:22.440 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102784.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102784.log.gz 2024-05-04T07:56:22.441 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41091.log 2024-05-04T07:56:22.442 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44031.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2024-05-04T07:56:22.443 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38913.log 2024-05-04T07:56:22.444 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41091.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41091.log.gz 2024-05-04T07:56:22.445 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38913.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38913.log.gz 2024-05-04T07:56:22.446 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40012.log 2024-05-04T07:56:22.447 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40585.log 2024-05-04T07:56:22.448 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40012.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40012.log.gz 2024-05-04T07:56:22.449 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41761.log 2024-05-04T07:56:22.450 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40585.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2024-05-04T07:56:22.451 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-05-04T07:56:22.452 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41761.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41761.log.gz 2024-05-04T07:56:22.453 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-05-04T07:56:22.454 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44073.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-05-04T07:56:22.455 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2024-05-04T07:56:22.456 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40417.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-05-04T07:56:22.458 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-04T07:56:22.458 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39335.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2024-05-04T07:56:22.459 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102658.log 2024-05-04T07:56:22.459 INFO:teuthology.orchestra.run.smithi136.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-04T07:56:22.459 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39125.log 2024-05-04T07:56:22.461 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43863.log 2024-05-04T07:56:22.461 INFO:teuthology.orchestra.run.smithi136.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102658.log.gz 2024-05-04T07:56:22.462 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39125.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39125.log.gz 2024-05-04T07:56:22.462 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-05-04T07:56:22.464 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45026.log 2024-05-04T07:56:22.464 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43863.log.gz 2024-05-04T07:56:22.465 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43201.log 2024-05-04T07:56:22.465 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 2024-05-04T07:56:22.466 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45026.log.gz 2024-05-04T07:56:22.467 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2024-05-04T07:56:22.468 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63979.log 2024-05-04T07:56:22.468 INFO:teuthology.orchestra.run.smithi136.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43201.log.gz 2024-05-04T07:56:22.469 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-05-04T07:56:22.469 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2024-05-04T07:56:22.470 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.63979.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.44613.log -- replaced with /var/log/ceph/ceph-client.admin.63979.log.gz 2024-05-04T07:56:22.470 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-05-04T07:56:22.472 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-05-04T07:56:22.472 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-05-04T07:56:22.473 INFO:teuthology.orchestra.run.smithi142.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-04T07:56:22.473 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44613.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-05-04T07:56:22.473 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2024-05-04T07:56:22.474 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43905.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-05-04T07:56:22.474 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-05-04T07:56:22.476 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39041.log 2024-05-04T07:56:22.476 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2024-05-04T07:56:22.477 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-05-04T07:56:22.477 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-05-04T07:56:22.479 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39041.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39041.log.gz 2024-05-04T07:56:22.479 INFO:teuthology.orchestra.run.smithi136.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-05-04T07:56:22.480 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39083.log 2024-05-04T07:56:22.480 INFO:teuthology.orchestra.run.smithi136.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-05-04T07:56:22.481 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40333.log 2024-05-04T07:56:22.481 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-05-04T07:56:22.482 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103094.log 2024-05-04T07:56:22.482 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39083.log.gz 2024-05-04T07:56:22.483 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43285.log 2024-05-04T07:56:22.484 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40333.log.gz 2024-05-04T07:56:22.485 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.103094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2024-05-04T07:56:22.486 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103094.log.gz 2024-05-04T07:56:22.486 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43285.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-05-04T07:56:22.486 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41803.log 2024-05-04T07:56:22.488 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102574.log 2024-05-04T07:56:22.488 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2024-05-04T07:56:22.489 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41803.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41803.log.gz 2024-05-04T07:56:22.489 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101722.log 2024-05-04T07:56:22.491 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102574.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102574.log.gz 2024-05-04T07:56:22.491 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102364.log 2024-05-04T07:56:22.491 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101722.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101722.log.gz 2024-05-04T07:56:22.492 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102910.log 2024-05-04T07:56:22.493 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102952.log 2024-05-04T07:56:22.493 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102364.log.gz 2024-05-04T07:56:22.495 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38869.log 2024-05-04T07:56:22.495 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102910.log.gz 2024-05-04T07:56:22.496 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64453.log 2024-05-04T07:56:22.496 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102952.log.gz 2024-05-04T07:56:22.497 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38869.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38869.log.gz 2024-05-04T07:56:22.498 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-05-04T07:56:22.498 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.64453.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64453.log.gz 2024-05-04T07:56:22.499 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-05-04T07:56:22.501 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-05-04T07:56:22.501 INFO:teuthology.orchestra.run.smithi136.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-05-04T07:56:22.502 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43648.log 2024-05-04T07:56:22.502 INFO:teuthology.orchestra.run.smithi136.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-05-04T07:56:22.503 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45236.log 2024-05-04T07:56:22.503 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-05-04T07:56:22.504 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43648.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43648.log.gz 2024-05-04T07:56:22.504 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45532.log 2024-05-04T07:56:22.505 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.45236.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45236.log.gz 2024-05-04T07:56:22.506 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40766.log 2024-05-04T07:56:22.506 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.0.45532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45532.log.gz 2024-05-04T07:56:22.507 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101420.log 2024-05-04T07:56:22.508 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-05-04T07:56:22.508 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40766.log.gz 2024-05-04T07:56:22.510 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102490.log 2024-05-04T07:56:22.510 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101420.log.gz 2024-05-04T07:56:22.512 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44571.log: gzip 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-05-04T07:56:22.512 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41100.log 2024-05-04T07:56:22.512 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101775.log 2024-05-04T07:56:22.512 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102490.log.gz 2024-05-04T07:56:22.514 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43243.log 2024-05-04T07:56:22.514 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41100.log.gz 2024-05-04T07:56:22.515 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.101775.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38783.log 2024-05-04T07:56:22.515 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101775.log.gz 2024-05-04T07:56:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.43243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2024-05-04T07:56:22.516 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43243.log.gz 2024-05-04T07:56:22.517 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102196.log 2024-05-04T07:56:22.518 INFO:teuthology.orchestra.run.smithi136.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38783.log.gz 2024-05-04T07:56:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.42870.log 2024-05-04T07:56:22.519 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-05-04T07:56:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102196.log.gz 2024-05-04T07:56:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44299.log 2024-05-04T07:56:22.522 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.2.42870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44741.log 2024-05-04T07:56:22.522 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.42870.log.gz 2024-05-04T07:56:22.523 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38825.log 2024-05-04T07:56:22.523 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44299.log.gz 2024-05-04T07:56:22.524 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44741.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44741.log.gz 2024-05-04T07:56:22.524 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39838.log 2024-05-04T07:56:22.525 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38825.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-04T07:56:22.525 INFO:teuthology.orchestra.run.smithi136.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38825.log.gz 2024-05-04T07:56:22.527 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2024-05-04T07:56:22.528 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.a.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.39838.log.gz 2024-05-04T07:56:22.529 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41887.log: -- /var/log/ceph/ceph-client.admin.103052.log 2024-05-04T07:56:22.530 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2024-05-04T07:56:22.530 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101859.log 2024-05-04T07:56:22.533 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.103052.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103052.log.gz 2024-05-04T07:56:22.533 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.101859.log: /var/log/ceph/ceph-client.admin.40765.log 2024-05-04T07:56:22.533 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101859.log.gz 2024-05-04T07:56:22.535 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2024-05-04T07:56:22.536 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-05-04T07:56:22.536 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-05-04T07:56:22.537 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.41426.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2024-05-04T07:56:22.538 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38997.log 2024-05-04T07:56:22.540 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.39251.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-05-04T07:56:22.540 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40543.log 2024-05-04T07:56:22.541 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38997.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38997.log.gz 2024-05-04T07:56:22.542 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102826.log 2024-05-04T07:56:22.544 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.40543.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40543.log.gz 2024-05-04T07:56:22.544 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log/var/log/ceph/ceph-client.admin.102826.log: 2024-05-04T07:56:22.545 INFO:teuthology.orchestra.run.smithi136.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102826.log.gz 2024-05-04T07:56:22.545 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-05-04T07:56:22.547 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.44487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2024-05-04T07:56:22.548 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42093.log: /var/log/ceph/ceph-client.admin.102448.log 2024-05-04T07:56:22.548 INFO:teuthology.orchestra.run.smithi136.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-05-04T07:56:22.551 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.102448.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102448.log.gz 2024-05-04T07:56:22.806 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-04T07:56:22.839 INFO:teuthology.orchestra.run.smithi136.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-04T07:56:23.086 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-04T07:56:23.101 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-04T07:56:23.108 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-04T07:56:23.148 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-04T07:56:23.164 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-04T07:56:23.167 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-05-04T07:56:23.168 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.891s 2024-05-04T07:56:23.168 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m3.304s 2024-05-04T07:56:23.168 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.365s 2024-05-04T07:56:23.279 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-04T07:56:23.315 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-04T07:56:23.317 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-04T07:56:23.321 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-05-04T07:56:23.322 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m1.047s 2024-05-04T07:56:23.322 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m4.066s 2024-05-04T07:56:23.322 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.813s 2024-05-04T07:56:23.323 INFO:tasks.ceph:Archiving logs... 2024-05-04T07:56:23.323 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi136/log 2024-05-04T07:56:23.324 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T07:56:24.068 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi142/log 2024-05-04T07:56:24.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T07:56:24.585 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-04T07:56:24.596 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-04T07:56:24.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T07:56:24.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T07:56:24.764 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-04T07:56:24.776 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-04T07:56:24.776 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T07:56:24.784 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T07:56:24.832 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-04T07:56:24.833 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-05-04T07:56:24.840 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T07:56:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-05-04T07:56:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +359us[ +371us] +/- 45ms 2024-05-04T07:56:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -324us[ -312us] +/- 68ms 2024-05-04T07:56:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -116us[ -116us] +/- 68ms 2024-05-04T07:56:24.841 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:56:24.842 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T07:56:24.842 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-04T07:56:24.843 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +338us[ +342us] +/- 45ms 2024-05-04T07:56:24.843 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -361us[ -361us] +/- 68ms 2024-05-04T07:56:24.843 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -153us[ -150us] +/- 68ms 2024-05-04T07:56:24.843 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T07:56:24.844 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-04T07:56:24.858 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-04T07:56:24.858 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-04T07:56:24.869 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-04T07:56:25.058 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-04T07:56:25.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T07:56:25.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:56:25.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T07:56:25.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:56:25.435 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-04T07:56:25.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-04T07:56:25.453 INFO:teuthology.task.internal:Duration was 916.957037 seconds 2024-05-04T07:56:25.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-04T07:56:25.463 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-04T07:56:25.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T07:56:25.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T07:56:25.602 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T07:56:25.607 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T07:56:25.988 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-04T07:56:25.989 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-05-04T07:56:25.989 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T07:56:26.058 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-05-04T07:56:26.058 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T07:56:26.135 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-04T07:56:26.135 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T07:56:26.143 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T07:56:26.222 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-04T07:56:26.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T07:56:26.228 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T07:56:26.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-04T07:56:26.410 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-04T07:56:26.410 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T07:56:26.492 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T07:56:26.577 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-04T07:56:26.602 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T07:56:26.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T07:56:26.711 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-05-04T07:56:26.724 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-05-04T07:56:26.762 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T07:56:26.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:56:26.812 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T07:56:26.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T07:56:26.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-04T07:56:26.929 INFO:teuthology.task.internal:Transferring archived files... 2024-05-04T07:56:26.930 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi136 2024-05-04T07:56:26.930 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T07:56:27.318 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-04_04:44:58-fs-wip-rishabh-testing-20240503.134948-testing-default-smithi/7690555/remote/smithi142 2024-05-04T07:56:27.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T07:56:27.421 INFO:teuthology.task.internal:Removing archive directory... 2024-05-04T07:56:27.421 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T07:56:27.429 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T07:56:27.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-04T07:56:27.495 INFO:teuthology.task.internal:Not uploading archives. 2024-05-04T07:56:27.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-04T07:56:27.513 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-04T07:56:27.513 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T07:56:27.519 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T07:56:27.566 INFO:teuthology.orchestra.run.smithi136.stdout: 393947 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 07:56 /home/ubuntu/cephtest 2024-05-04T07:56:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 07:56 /home/ubuntu/cephtest 2024-05-04T07:56:27.578 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-04T07:56:27.589 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-04T07:56:27.614 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/acls} duration: 916.957037448883 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-05-04T07:56:27.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T07:56:27.704 INFO:teuthology.run:pass